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An editorial cbxnmeht. 



The Computer and the Mathematics Educator 



Kenneth J. Tr avers 



Uiiiverslty of Illinois at Urbana-Chanipaign 

How can the statistician control a computer, so that it 
;becbnies ah extension of himself, as the piano is to the 

plani:St:?^'::::::{^F^^ Computing in St^^^^ 

Science through APL , New York: Springer- Veriag, 1981, 
page 2.) 



r-^ Witthin the past few years, computers have become a part of our daily 

experience with startling rapidity. Few of even the most visionary among 
us predljzted the pace of this development. The disturbing aspect of aii^ 

this is whether, after all of the millions have been spent ~ dollars on 

........ .... .... _.. \ ■ __ __ \' 

equipment and hours on training programs. — as far as education is con- 
cerned it will be business as usual.^ 



/ ■■■ 



To be sure, our past experience with video technology, and programmed 
instruction before that, offer little assurance ; that we have learned how to 

exploit the power of technology .in pursuing significant new directions in 

■_ 1_ _ . :.. _ _ . . ' _ . - '2^ ' 

curriculum and instruction. The introductory high school afgebra ^course 

based on APL and developed by Iverson at IBM several years ago provides a 

case in point. The, course moves quickly from a scalar to a vectdi>-based 

algebra, thereby providing an enormous conceptual advance for dealing, say, 

with linear algebra and statistics. Yet there is scant pubilc; evidence 

that these materials have been taken seriously by curriculum \deyeiopers or 

supervis 

."■ ■■■■ / ' ' • :-M ■ ■ ■ ^ 

We hear on every_^side pleas for a mathematics currlculuii which is 
more applicable to the real world" — a goal described 'by Hugh Burkhardt , 
./;ih his ;ju^t^ released ERIC review of applications of school inathematics from 
an international perspective, as "the eiusiye Eldorado." Now we need- to 



_ _ _ / -■ ^ 

aee icdicatldns that the power of the 'computer has been turned loose and 

_J . / ;. . 

put in the hands of the teacher as a tool which can / make a difference in 



the- Kiea of mathematics taught , and the way in which mathematics is taught. 

.. ........ . . / .. .. ..• 



Consider the case of instructional applications -^b Monte Carlo 

^thbd. Through this method, concepts iri physics dealihgHlth heat flow, 
and electronic circuitry can be handled without the .advanced mathematical 
knowledge required by conventional approaches.;^ Likewise, statistical ideas 
such as sampling distributions and confiden&e intervals are readily acc^ssy 
tb£l) to high school' students of average ability. The method 'enabl.es an / 
e^erience-based, hands-on approach which greatly enhances instruction. / 
All of this is made feasible and attractive by .the growing availability o^^ 
con^uters in classrooms. / 

: ■ . ■ ■ . • . . ■ ■ ■ " : ' . J 

One iii?)ediment to* progress may be that, school mathematics ^ arid / 

. . _ - _ _•- ' : _ ^_ __: . /_ __ 

therefore mathematics educators, have been dominated by an arithmetic view 

. *. _ . .. ... . . . .■• . . '.. ■■' _ •_ / . 

of the world. (After all, until about 100 y^igf^go. Harvard required/ 

only proficiency in arithmetic for admissioni) So it m^ follow tha^. the 

natural order offings has brought about a dbmiriatirig view of the con^uter* 

as only a fancy computing, device. From this pbint of view, the French have 

a much better name for this awiasdme iriveritibri. They call the computer 

"ordinateur," which is a word whbse rbbts mean "to order," "to arrange," 

"to tidy up." ' / 

• . -j ' :\ 

In the field of research in mathematics education, we have an in- 
structive example of how the non-computational role of the cdii?>uter can 
charige/tjtie nature of the enterprise; The Firs t'intematiohal Study of 
Mathematics, carried out in twelve countries sdme twenty years agb,^^^-' 
signaled mariy firsts in' educational research, the most obvious being that 
it pioneered large-scale survey research acrdss. a large number of . language 
groups, educational systems, cur^riculums , tochers and students, and sb 
forth. Not sdjwell kndwri is the fact that it was "state of the art" in 
terms of coc^uter-based technbibgy fbr file-building, data cleaning and"'^" 



. diecklhgi' and sti^fcistical analysis. In the report of the First lEA 
Mathematics Study, Wolf points outi that the non^computational operations ! . 
performed by the' computer were "absblutely crucial" to the conduct "of thje 
^i-oject^ (Husen,/.i967, Vol. 1, p. 285) . The pioneering nature .of the First 
lEA Study is exemplified by the fact that the IBM 1230 Optica! Mark Scoring 
Reader was still under development |.n 1963. (for example, guidelines for 
the preparation of machine-readable answer sheets did not even exist at ^ 
the time.) The end product of the data preparation phase of the study was 
Se Storage of some 50,jDillion :i terns of information on "slightly more than 
one half of /a single reel of magnetic tape" (Wolf , ibid, : p . 215). ; 



In the Second Ihtematibnal, Mathematics Study there are examplars of / 
*how computers continue to .change > the nature of research activity. Like the 
First International Stiidy^ the entire project,, because of its scale and ' 
coinplexity , clearly could not 'have beeS done at all without computer / 
assistance.^ . • . ' > . 



in the Second Study ^ data-based management techniques permit the • 
jnflii -fpHlar-f nn nf massive amotmts of data in many^ many data sets,: for the 
purpose of cleaning, checkings filings ahd^ later 011^^ for exploration and 

analysis. This technology in combination with computer networks across ; 

/ . ■ ■■ - - - _ __ ^ _• ■- . - / 

North America enables transmission of both raw data sets and computer 

/ • • , - . ' . :■- -•-/-.:- 

dutpuL to researchers at other institutions engaged in tl^. Study; Inter- 

continental networking through satellites is now being established, for in 

ad /interna tibhal study one of the major problems is that of fast and 



effective communicatibn between participants (which in the Second Inter- 
national Mathematics Study are found on every continent). 

w / In what other ways might the cbngjuter have an impact on ways in which 

/we do; research? In experimental design, one could specify models for 
analysis given the purposes and conditions of a study. Then with simu- 
/ latld data the. performance of the' model, given various sample sizes and v 
conizations of variables, could be explored. In the realm of exploratory_ 



data analysis, li; Is essential that a quick arid easy-to-read method of 
aispiaying/ various configurations o'f data be available. One wonders how 
nnich rd:al|explbratlbn of data with sets of more than a few cases can be 
done^ without the aid of a .computer. In. secdndary analyses ,^^^ t 
of acceaS'ing data bases in a "user-friendly" mode is essential.' It's a 
great pity that in many if not all of the large data cdllectldn activities 
wiil^ hajv^e been undertaken in the past, the data themselves have been 
greatly /urider-mined (that is^ hot mined to any where .hear their full "pay^ 
, dirt" capability) . The con5)uter is an essential. tool in such endeavors. : 

. / : ' ' . . ■ ■ 

As educators, we are dismayed when talent in our students remains ^ 
f- - • ^ • _ - _ - - , -•■ - ■ -_ , ■ 

undeveloped.: "Johnny/Mary is not doing his/her best." The iahder- 

utiilzation of the resources of the computer is a cause of concern, too. 

/ ■ p . - •' ■ . • - ■ .' ■ 

* _ _ ; _ . * ■ . ci - , • 

We face enormous problems and challenges in the^^wanlng years of this 
century . — hdt the least of which is to help Johnny/Mary do his/her best. 
The computer has potentials* for mathematics education which we have barely 
beguii" to realize. Are we creative enough to foster, nay, exploit its 
power? 
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i. Purpose 

The study sought: (1) to support the contention that children's"" 
processes for production of answers, for basic ad^dition facts changes 
developmentally from computation via^ counting algorithms to a memory 
retrieval process, and (2) to obtain information about the age, or age 
^atige, during which the* shift from counting to memory, retrieval occurs. 



_.,2..-' ^Rationale 



A widely held view about children's mental addition process is that 
they obtain answers by reconstructing or computing using a counting 
ilKorithm. Models developed f rom Iseveral research efforts using response 
time (R!T) . support the so-called "min" model. This model suggests that a 
problem such as ^+ 4 is solved by setting a "mental counter" to the 
inaximum addend,^, and incrementing by counting the value of the minimum 
addend, : 3, up to the answer of 7. There are several lines of evidence 
howeva^, to Suggest a switch, sometime after first grade, from this 
reconstructive procedure to a memory retrieval process. The "min" model 
is suggested. by research among youpg children which finds RT to be a 
linear function of the size of the minimum addend. Research among adults 
finds RT to be exponentially related* to the size of the minimum addend; 
this, together~with other research relating'^adult RT to addend and sum 
size, sugge'Sts that adults retrieve -addition facts from memory*. ; A shif t 
from reconstructing to retrieval is suggested. 

3. Res^ar^ H Desig n and- Procedu res^ V :*~V 

The subjects were 30 elementary schbol_Ghi;l^^ 

from^ grades 3, 4, and 6, rfesultinr^ in a sample with mean age distribution 



of 9«04i 9.63, arid 11.7? years and raaie/female distribution of 6/4^ 8/2, 
and 4/6'by grades, respectively.. ' - 

' The stimuli were^lOO basic-fact addition problems (i.e., stms ^ 18) 
presented in^ coii^^i^orm wi th the answer below: the liiie . Fif ty addit ion 
combinations^were randomly selected to be given with correct answers; the 
remaining were presented 'with wrong answers randomly Satiating (Split) - 
from correct by ± 1, 5^ 7. Stimuli were randomly ordered for presentation 
except for two appropriate restrictions^ • 

The procedures were that stimuli were prb3ected onto a screen and 
subjects responded -by pressing one of two buttons, randomly left or right,, 
to indicate trie br false. Response time was measured with appropriate 
apparatus. Subjects were test|ed individually in a darkened room. Among 
other instructions to the subjfect was that equal emphasis would be placed 
oh accuracy and speed. Tweritylfjiractice items were given during which 
procedures were reviewed and emphasized. — 



7 



7) as variables. 
RT decreased 



4. bindings 

Using "extremes « out" RT data (after an appropriate test of outliers) 
a 3x2x2x3 analysis of variance ^as conducted. This design was a mixed 
modei with Grade. (3,4,6) X Decision type (true^ false) X Problem Size. 
(amail. suin£ /9, large; 10 sum 18) X Spilt ( ±1, 5, 

This analysis found"'' all main effects to be significant: 

*'Ov.^^•v•;r ■ _ _ , ■ ;. \_ _■ ■ 

across grade level, triie problems were faster than false bnes^ Small 

«'c : . . _ » '-\ -- - — _ _ '- _ -- ' - - - . 

problems were faster than larger , and\ split 1 RTs were slower than, 5 and 1. 

i^*, ^•V^ __. _ _ ■ \ _ JL^ (___;._ ■ \ ... 

j^.S^li^ Decisiori Type interaction revealed' a declinej in RT to. false 

problems as split increased. There was a significant ^our-way interaction 
showing that RT decreased from third to fourth to sixth grade, a cbnsistent 
true/false effect was found, at all grade levels'^ and large problems 
required more time than small. \ 

The authors indicate that tl^e interaction patterns suggest that 
third graders used different processes than fourth and. sixth graders; 
:^ird graders~-exhibi.t a_^ problem-size effect than- fourth^ 

and sixth graders i For this reason a moTe \refined^regression analysis to 



examine the projjlem-size effect and what variables sesm to^^ It 
was conducted. : - 

For a stepwise regression analysis,* RT seirved as -the dependent 
variable! and among the, 15 pfedlctbr varlaib^^ 

addend^^the correct sum, square of the correct sum,, number of digits In 
sum, .ii ^The results of this stepwise regression give support to the 
authors* cohtentibn that there is a process change between yourig and oTder 
children's performance;^ For third grade, only one predictor variable^, 
number of di^gits in the sum, accounted for a sufficient amount of variance 
(R^ » 56i4).'to enter the equation. For^f ourth and sixth grade only the : 
variable ^correct sum squared^ entered with - 67.9. -No other variables 
added a significatlt increase in the variance^accounted for in either case. 

Each ^f these two predictors involved problem. size, but a different 
aspect of /it. A simple increase iri R as a result increased problem 
size (as indicated by number pf digits in stua) is a benchmark in the 
research area* so the sum squared variable is Jfaken to set the third 
grade apart from the fourth and sixth. The^sum squared variable is, inter- 
preted asah index of memory search. Since the results suggest that a 

■ - * * ^ ■' . ■ ■ 

longer mental "distance" is traversed for larger probieips, th« authors. 

indicate that fourth and sixth graders are using processes of mentals 
retrieval similar to those employed by adults. \- 

5. Itit erp r^tat Idtis ' v \> . ^ 

Since the counting model for processing basic fact additions fits 
^the data for about half of the third-grade subjects, whil^. data^ f or the 
other half resembles more that from the fourth and sixth g^t^^ade^ it appears 

•±hat third grade is a time of traiisiti'onrf rom counting to memofy retrieval 

.__ Mx, / ;■...._.. : 

for obtaining answers to basic addition tacts. Third-grade children 
apparently have numerical magnitude infdrmatidn stbred as a mental 
representation. This is suggested by the observation that third graders 
(at least some) use memory re trie>^l- for . basic facts which requires a 
ment;^!/ representation of arithmetical inforinatibni The switch from use 
of accounting model begins as early as the third grade and is apparently 



complete by the sixth grade. Research results indicate 'tha't sixth graders 
^^are still less efficient in their basi^ than : 

iaults. . This a speculative hypothesis that ''somp of the relevant - 

cdg^iltive prdcesses for addition shift from a slow, conscious process 
to a; fast autbmatic one^ as. a function of mastery^ overleamingi practice, 
■'aiwi/i6r/;age'V. (p^ \ >'.• ~" f^T" " / ' \; ^ 'r''*'7'"> i*^" ' 



Ab&tract^^ Cdmment 



ThUs exceilent article adds significantly to. the knowledge: base 



'./•• 

concerning ybi^^ processing of basic a;dditidn\ facts. The study 

fii'aa( J:!are fully and ' logically .conceptualized ; and conducted with s.cientlf ic 
"^tgp^^^^ gives adequate information for repiicatibn; 

'fB^adp '±p ±s c^^ succinctly written so that it is easily read by ; 

'a knowledgeable reader. _ ' 

> As with, other studies from which inferences are made about mental 



processes based on the goodness of fdt between an hypothesized model and* 
response time data, the coricliisidns: d,f ^ this study must be viewed' as 
tentative., edrroborative eyid^ence 'from clinical research using subject 
prbt9c61 dat a' aris in g-;, from " think- aloud" d r "s el f-repp r t ing" pro ces s es ; :is 



necessary. 



-/ 



j^ -The M raises some interesting questiions which remain, to be 

"r" _• . ; . ../,'._.:/■__ . _ \/_ ■ ■ _ _■ '_ ■/ ... ... . 

investigated in the area of children's mental processing of basic addition 

.factsi''- " . v. " ■ ^ . ' " . 



BSlleWi Hunter ^aSa 'Cunni^^ W. DIAGNOSING^STRENGTHS^ ^ ' _ 

WBSIaiESSES IN SJXTi^^?^^ IN SOLVING iWORD^ROBimS/^^ Journal 

for^ Res ear ch In Ma thema t ic s lEduc a t lo n 13 : 262-221;; May 1982 . 

^stract and comments prepared for- I. M.E* by IAN D; ?EArriEi . Uhiversity 
oi British Coiumbia,^ Vancouver i . | / 

.1;. feirpose • -•'■"*,.....". . V yy . •'. 

stated purposes pf this "s tudy were: (a) to identify the . 
main sources of difficulty that elementary school children have in 
solving word problems, and-"'^) to determine whether an efficient 
diagndisis Of the main^if f iculty of an individual child is possible. 

2. Rat4:bii^le '/^ \ . ^f^' .^ ■ '\/ i ' ■, . ; 
The tmc^r^ assump tion -is-that-polvirig-word p^ 

a unidimehsiohal process. The authors cite studies to siippdtt their 
contention that confputational skills^ reading ability^ and ability to 
Interpret the problem are important factors in .solving wdrd problems. 
They-arsb~^assert"^^t^^ the .ability to integrate these skiiis .is an 
important factor i although this aspect has hot been preyibusl^ 
gate^d. The a,uthors' beiieve that data derived from the study will 
Improve instruction in solving word problems and facilitate research 
In the area. • ' ^ j - j ■ 

3. Research-Design^ and Fr o cedures ; - : . 
the subjects in the study were all . 244 sixth graders in two 

elementary -schools iii North Carolina.^ A basal mathematics text for 
grades 3-8 was. used to develop three tests for each b£| these grade 
levels. The/ tests were constructed by ' taking the Mrs t^'^^^ word 
problems in* each word probieni* sect'ibn yand randomly ; assigning them to; 
cme of three groups. One group of pTOblems was set- lip in computational 



form to be admeasure of computational ability. ^ Two-step problems 
^ontribiJt^d/ two items -to the test. A second, group of w^ problems 
was used jto develop; a problem interpretation test. Ilie^ problems 



WjBte /read* to the students^ who were also given the written form of 

the problem. The students were required oniy to show what calculations 

Would be necessary^ hot ;tb complete the calculations. The third group 

of problems was presented* in written form only, and students were required 

to show the necessary calculations (reading-problem interpretation) 

and to complete the calculations , (reading-problem solving) . 

These three tests jpxbduced [a profile of four scores for ea^h_ 

student: a ^ornp u t a t 4on^ s core , a P roblem Xn^rp^^e^atim^ score, a 

■_ _■ . ■■_ ■_ / 

, Reading-Problem interpretation scores and a Reading-Problem Solving 

score. A student's score oh each test was defined tp be the highest 

level at which 75% of the items wer^e answered correctly The tests 

were administered to all students. Complete data were obtained for" 

217 students. Areas of strength were identified by comparing computation, 

problem-interpretation, and reading- interpretation scores. Ah area 

. of strength was defined to be one in which a student's score was one 

or more levels above his or her scores in the other areas. The ^ _ 

procedure for finding areas df greatest need was *more_^compl'ica — T'^s" 

it included the reading-problem solving score- ahd'^severai "decision 

rules" to apply; when scores were the same. These rules ensured that 

an area of greatest need was identified for each student; i 

• Findings . 1 

Application of the decisibh rules to test scores identified the 
areas of greatest need as follows: computation (26%) , problem inter- 
pretation (19%) i reading-problem interpretation (29%) , aaid inte 
of these areas (26%). Of the 217 students ^ 108 had an area of strength 
as follows^: Computation (75%)^ problem interpretation (21%^ ahd reading- 
problem interpretation (4%).- When compari-son of pairs of scores -, . 
was made, including those students with incomplete data^ it was fouhd ..: 



that: (a) ^computation scores were generally higher (45% of, the students) 
than probiem interpretation scores (17% of the students), whilst th^ - " 
scores were tied 38% of the time;' (b) cdmputatidh scores \were generally , 
^igher^(60% of ' the students) than ireading-problem interpretation scores 



(12Z of the studeht§)> whilst the; scpresl^ t±€d^^8% of the tiiafe; 
aad /(c) problem interpretation scores were higher C44%^of the* students) 
than reading-problem interpretation (13% |of : the students) ,\whiist the 
scores; were tied 42% of the time. 

/ - ■ • . " . - . , ^ • • 

5. laterpretaxions 

Tfie autljprs recognize certain limitations in the study. The word 
problems were' select ed-^frotn a single basai, series and jthe sample was 
iiiited to sixth-grade students. wiSthih; tjhese limitations, the authors 
conclude that prdblem-sdl^ing ability is composed, of several component 
abilities, each of which can be: a cause of difficulty in sblving word 
problems^ but §ugges^t that masteryxbf the component abilities is not 
^sufficient to guarantee success in solving word problems. They also 
suggest that reading ability is of greater importance in ^solving word 
problems than has been believed. Finally, the authors conclude that ^ 
"iii wealmesses and strengths in the major area of skills in solving word 
problems can be diagnosed thr'ough ^use of a comparatively simple proce^dure"* 
and that "... individual students should receive- .treatment specified 

according . to their areas of most immediate major need." 

■ : * ■ ' f ; ' ' /_ ■ 

" : Jibstraetor^s Comments i 

The authors are to be commended: for undertaking a study to explor,e 

■ ■ ^ - - . - - - - - / - 

an area in which research has little to say of a practical nature to / 

thbse concerned with diagnosis and remediation. Investigatbts. are - / 

generally concerned with how to teach problem solving, not with deterr- 

mining sources of difficulty. It should- be . noted, too, that investij- 

gations in the a?ea of diagnosis are not always amenable to standar| 

research methods. The. approach lised by the authors is not "only interesting 

.-, ■ . . \, :_ . ■ -.._jf _ : ; 

but yields useful -information. Undoubtedly the methodology use<r here 

wili be refined' and used in further studies. However, the reportNi : 

•itself lacks ^laritjr and omits a great deal of pertinent information 

that should have been included* Following are some concerns iti yhose 

areas: 



1) It was never made clear to the reader whether the purpose of / 
the study; was to develop a classification scheme and to verify it;'. / 
or to use^ one to detbrmine areas of difficulty. Discussion in the / 

Problem and Design sections of the report suggest the former objective^ 

■ - - -- - - - ■ _ _ _ -_ " / 

but the Data Analysis and Discussion sections are devoted entirely j 

to '.determining areas of difficulty. The investigation would have 

benefited from a pilot study where the focus was, on the classification 

scheme and^ft's verification. Then the ^second,^ stated purpose, wliich 

should really be the first, cbuid more |5roperiy be addressed. | / 

2) The description of the test leaves many questions unanswered. 
The cbttteht and /degree, of difficulty of the items must have varieS- ^ 
greatly over the span of grades 3-8. No infoinnatidn is given as^^ 
how many items were in each test at each gride level; what operations 
were involved and in what proportion; what concepts were covered 
(area ^ volume^ etc*); whether the operations were on whole numbers, 

fractions, decinfels^ or integers; or how many isroblfeins were of the one_T_^.! 

step or two-step type. \ it is possible that further analysis would 

reveal differences across these i • 

3) Procedures_for th'|£ test adiriiuistration are ,not clear. No . 
^Jjifoirxnation is given regarding time allottment, the order in which . ' 

the three /tests were administered, the interval bett^een test administrations 
how the scoring was done (e.g., for two-stej) prbblem-interpretatibn, 
was there partial marking for each' of the two cdmputatidns set up?), 
or wheth(Br all pupils started with the grade three level test. The 
order of administration, particularly, could have an effect oh the 
results. The Reading-Problem Solving -3cb^e, for example, . could 
conceivably be enhanced by administration sh^x^ly after the Reading- 
Problem Interpretation tesi. / \ i " 

^4) The decision.rules are designed so that every student must have 
ah area of difficulty, this seems unreasonable. is it not possible 
that some students afe equally able ih each area? It could be argued^ 
In fact, that such would be a desirable goal. .The second decision 
rule includes the statement that "Students also/cannot be expected 



to iaterpret wprd '^robiems when reading them if they /arfe iinable to ; 
^ intei^ret -them when they hear 'them read aloud." The results show that 

'13Z-of the students Uid score higher when they did not heW the 
^problems read aloud. The rules need to be rethought with Vhese points 

^In.iaind.. ' . ' ■ A.' . -^v 

5) The authors* compare the petf ormahce of students who ^^ave the 

problem read to them with their perf briiiance when they- hav^ to^ read 

the problem themselves. in fkct, th^comparison shoulci^be of \>er- 

- " ■ _ -■ _ 1 ^ _' - - - . - ' -V ' .• - . ■ ^ 

formance when students have the problems read to them ^nd— h ave the 

l__ '_ _ : \ \. . . 

opportunity to read it with performance when /students can only r^ad 

\ -. ■ V -_. .. . . i^r. \ . '...•„ . ■/. ■ . V ■■ Y • ' 

the prot^lem. / \^ y 

Despite these limitations, the investigation is ptill of value. - 
If therquestions raised are addressedi perhaps using the data already 
gathered, the approach used should be followed Sy similar studies 
wHich wi^ produce much needed information regarding the' diagnosis 
and remediation of . difficulties in solving word problems. 



Bander, R±cki S.V K; ; And ZambstiSyi Kathy P. A CGMPARISON 

OF CUE--CONTRbLLEb RELAXATION AND STUDY SKlttS IN THE TREAT^^ OF .M^TH- 
MATICS/zAilXiETY. \ Journai of Educat±onal^Fsycholbgy 74: 96-103; Fe&ruary 

ia>8tract and connnerits prepared for I vM^B. '^by JOANNE ROSSI BECKER, Virginia 
Polytechnic Institute and State University. '! 



^This study exaiii 



ed the relative effectiveness , of mathematics study 



skills trainings cue-cphtrblled relaxation, and a combined stiidy skills 

•■'>•"' . . , . . ./ ^ . ■ . ' ■ 

and cue-controlled relaxation treatment of mathematics anxiety. \ ■ .i 

_' /' . . * " - . . . '., ■ ' ■ . ■ . ' , .'J . . \' '"■ 

2. Rationale / , " N," 

The authors note that; problems, of mathematics avoidance and achi^^-r 

ment have received increasing attention and that mathematics anxiety i hasv 

been used as one explanation for both avoidance and poor i performance. 

While vsgme research has ^investigated relationships of affective variables 

to mithei^ studies have provided, littl^^e guidance 

for designing intervention programs to treat mathematics anxiety. ' . • 

; Because mathematics anxiety may function in a way similar to test 



-/--,- ... 

3|Src 



anxiety, . treatment apprbachesTound effective with test anxiety might also 

. _■ , ■__.,../ ■ .. 

be useful with mathematics anxiety. Therefore, cue-controlled relaxation 

- ■/ -- ■■ A - / , - - - - - - - - 

was chosen as dne pff the treatments • Because improvj^ent itl mathematical . 
skillso* might reduce anxiety, study skills trainin§-was c^sen as the 
second treatment. A cbmbihed treatment was chosen because test anxiety 
research indicates that 'multi component programs/may be more effective 
than single component ones. 

3 • Research Design and^Prbcedures - ~ 

J, The subjiBcts were .36 college students who scored more than one 
Standard deviation below the mean oh the Mathematics Anxiety Scale.^ 
Pretreatirient assessment included readministration of the Mathematics ^ 
Anxiety Scale; the Anxiety Differential, measure of state anxiety; the 



Trat Anxiety Scale the Trait Fom of tKe' Strait-Trait Anxiety Inventory 
to measure trait anxiety; the Digit Syrobbl Test , ,4 performance test ; and 
the numericai stib-scaie of the Differential Aptitude Test; 

Subjects were randomly assign^d\to one of the three treatment groups 
(ctie-cdntfdlied reiaxatibri,, sutdy s^il^ these 
tiro) > or to a no-treatment coritroi gorup . Each treatment grdt^p met one 
hour per week for five consecutive weeks. The study skills tr&lning was 
des±gned:;to develop more effective study habits , anii included so of 
pfbblfems and discuss'^'on of underlying mathematicai, conceptsi^ ^ • cue- 
controlled reiaxatidh treatment was designed to help /people achieve relax- . 
ation iii.r,esponse to a self -induced cue word, ••calm." The combination 
treatment included the same cdritent as the two sihgle^component treatments, 
but with less in-session practice- " ^, > ,j\ 

Otie Week fdllbwing the end bf treatment sessions i . the six dependent 
measures were administered * to all grpupis) Three weeks later, a\follow-up 
battery^ consisting bf the Mathematics Anxiety Scale, the Test Anxiety 
Scale, and the Differential Aptitude Test, was giv^n to the treatment; 
v^ ggQups only . It, was hypothesized that : the combiried treatment would Be 
tthe most effective in improving scores on the Mathematics Anxiety Scale, , 
the 'Test Anxiety Scale * thiP^ifferential Ap titude Test^ and the Digit SyTobbl^ 
Test; and the. study skills and combination treatments wduld be significantly 
nipre effective than the other two conditions in reducing general trait and . 
.state axixiety. 

'\ A priori cqmp_arisons' were'Tdone to determine maii^ treatoenjE effect ^ 
by\ cofliparing^ the ti'eatment grdups td the cbntrbl grbup^ the coinbihed 
treatment group to the average of the single component groups and the 
relaxation grdup td the study skills grbiip. . Separate comparisons were . ^ 
done^pre to post and post ta follow-up for each variable available. ^Ct^-' 
Multivariate "analyses bf variance with repe^ated measures" were" u^^ to ' 
comparS the pre<- to posttreatment assessments on the six variables: fdr the 
f bur "gr^^ and tb cbmpare the posttreatment and follow-up as'sessments 

(on thd three variables given as follow-up) for the three tre^^ment gfdiips . ' 
Univariate analyses of variance were 'used with each apprdpriatict dependent . 
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variable; When-Group X Time intetactlbns were significant, Dunn's post 
hoc comparisons wei^S'.performe j " 

4. . Findings . ' ^ ' ' ' . / " i/ ^ _^ " , ' ^ " ' ' 

' r For the first two testing times, significant effects were found on 
the MANOVA (six Variables) for Time and the Group. X Time interaction. . Fo 
the posttreatment follow-up testings /three variables) , significant 
differences also were found oh the M^*OVA for Time and the Group X Time 
interaction./ No overall gr^up differences were found. 

* ■' ^ ■ ' ' j ' - ■ -"^ ' • 

Findings iiomythe a priori comparisons,, univariate AKOVAs, and post 
hoc comparisbns/are rather cbmpliBx; these^f inding$ ^re summarized here in 
an attemp^^ toi/ provide a clearer/picture of results on each variable. ' ^. 
/I. Mathematics Anxiety Scale . ^ The^/study skiiis treatment reduced^, 
Smciety significantly Sore than^ the oth^ three treatme did 
hb^t differ from pre to^bsttreatment. Hbw4ver, bri the pbsttreatment 
to follbwrnp analysis^ the stu^ skills and combinafiion^.trieatments . 
did not differ^ and \the jrtalaxation treatme^ showed significantly 

- greater -improvements : - -■ 7- ^.._„.... .^^ ... --.-^^ 

'2. Test Anxiety Scale .^. Cdmparisohs pre tb post shbwed the relax- 
ation and combination treatments to be stiperior to the stuS^ skills 
treatment and ni> treatment^ which did hbt differ. However * the 
po8ttre^tment/to folloV-up analyses showed only time significance;., 
all ^oups tested improved. |5 / . 

3.' ■ Dlffere4 tial-Apti^u de Te &t . The study skills treatment was 
better th^n the relaxation treatment, pre to. post.. The posttreatment 
to follow- up analyses showed that the stiidy skills trkatmeht j 
deteriorated over time, while the relaxation group improved on this 
variable;, the study- skills and combination groups were eriual at 

~f aiipw-up^. '^"y ; ^7 ..:~''^vl! 7^ ' 

Ai Anxiety Differential and Trait Anxiety Scale . . No significant 
/differences were found on these two variables i ' 

• ■ ■ ■ ■" ^ ■ W'.' - ■ - , . s ^ ...J ■■■■ _y" ■ 

^ , 5. Digit Symbol . Tlie study skill rela;}catiioni and hb treatment 
'/ groups were equivalent oti this variable ac the posttreatment assess- 



; tMaiti-^w^ more effective than these three in 

/ ieq^rovlng performance on this variable. ' 



5. Inte rpret s 

Tfie authors sXate that the iP of result^ pte to post Suggests 

that the study skills treatment was most effective in reducing mathematics ^ 
amd^ety, but the relaxation treatment was best in improving general test 
anxiety. T?ie combination treatment produced improvements on^test anxiety " 
mathematics anxiety, but was superior to the ind'i vidua! components only 
on the Digit Symbol Test. . \ / 

By the. three-week foilow^upi the relaxatibri treatment was superior 
^9*"^ J^^^^y i^^'^^i^ and combination groups :dii_-^^t^ Anxiety 

Scal^ and Differential Aptitude Test. The relaxation group continued to 

"^ i:' ; .._..„ ■ ■■ j : . . ■ ...,7 ■ : . . _ . • ^ .■ - 

Inpfove on all three dependent variables over th^e follow-up period. ' This 

Cdntinued improvement suggests the possible nee4 for sufficient tinie to 

elapse- for complete- development--of-a~ conditioned relascatibriTrespbhse . . rr 

The authors conclude that cue-controlled /relaxati^^^^ 



viable intervention strategy for treatment of/ mathemia^tics anxiety. • 

, : Abatrac tor's Commetits^ / ' \ . ; j : : : 

,The -Weaknesses of the design qf the study, wfiich the authors point 
'"ut, make it difficult to draw any. cdnclus ions a^>but the veff icacy of one 

treatment of mathematics anxiety over another; Besides the small sample 

. ^ .... . ' ' . - ■• - _. _ -J - :\ [ - ■■ . 

size, japnrepresentativeness of the sample, arid lack of normative "data on 

some scales,, the most critical flaw was' the failure to include the control / 

group iri the fdlldw-up assessment. Familiarity and experience with the 

_ _ i_ _ \- ■ ■■ ' ■ \ ■■: ■ ■■ .'J ■ .n 

iris triiments might have caused the imprdvement over; time dn, ^fdt eM 

the. T^ist Anxiety Scale and. Differe ntia, ! Aptitude Te^t. Without fbiibw-up 



testing of the control group, this aalternatei explanation cannot be excliided. 

The authors Stated they %ere in^iefes ted. in determining^ the reiatiye 
efficacy of these" intervention s trategies f dr reducing mathematics anxiet^ 
and; improving mathematics performance. , A more realistic test of the^treat- 
ments^from^this point of view might be to, examine student^ ' performance in 



mathematics. The failure b£ the study skills group's improvement in. 
anxiety to extend to the follow-up may be due to lack of practice of the 
skills outside th^ experiment. And. the Digit Symbol Tesrt seems like a 
poor measure df mathematics p.erfdrm albeit being anxiety-producing. 

The design of the treatments also merits some comments. The combined 
treatment attempted to provide both cue-cphtrolled relaxatidh and study^ 
skiiis in five ihours; it is questionable if these skills were ever ; 
attained in that time. In fact f five hours seems a short time to learn 
either the relaxation or study skiiis alone. How do we know if the subjects 

; ever attained either of these skills? . 

.\The data analyses were' fairly complex ^ but it still seems that thie 
findings could have been written mSSre clearly knd completely^ For example, 
I could not find in the report the result of the univariates ANOVA fdr the 
Mathematics Anxiety Scale for the post treatment to follow-up assessments. 
"AlMo^'sb^ bin relative efficacy iri ^h f*" ' g iirnma-ry-ff^ ah 1 ^-f in r- pn g cirr~< ~7 

comparisons do -no t--seem -to :be -sub"s^^^ No discussion of 

the testing of assumptions for the MANOVA was' included in the paper r^^^^ A^ 
.there is either an error in the descriptive statistics . for the study siciiis 
group -dn-the' Test :;^^ Scale, or an errdr in the text; 

•To the authors' credit, they are cautious in their conclusions. 

Becaiuse of the limitations of the study^ it is. difficult to conclude that 

: one treatment is better^ or that single component treatments are better 
than multiple cdmppheht ones. . There, is some indication that mathematics 
amdety can be improved by intervention, and that relaxation techniques 

.'may be useful. But definitive answer is. miist await further studies. 



Bkr^Elii Niirit and Raviv, Amiram. UNDERACHIEVERS AS ;TUT(3RSi . Jburnai 
of Edu cation al Resear ch. 75: 139-143; -January/February 1982. 

^stract Mnd comments prepared fpr I.M.E. by GEORGE Wi BRIGHT, Northern 
IHinols University, DeKalb. ! • * . 

■ 1. ; Purpose ' ! -^iV*' ^■ 

Underachieving fifth- and i sixth-grade students tutored second- 
grade students in mathematics as. a test; of the fbllbwirig7KypotK^s^s -^^^^^ ^ 
(a) The tutees improve in mathematics more than .second-grade students 
irfio are riot tutored. (b) Tlie tutors show more improvemeht. in mathe- 
matics, have fewer failing grades overall, and show a greater improvement 
±n self-concept than underachieving fifth- :and sixth-grade students 
^'^!H^ do not tutor. ^ . . 

Ratiohale , 
The research was conceptualized within the Learning Through Teaching 
paradigm which derives from a large body ^f peer teaching research. 
Recent research done within this paradigp has examined the effects 
of the tutoring on the tutors in additibh to the effects on the tutees, 
and this study was a continuation of these recent efforts. 

6 , . . * • ■ 

3. Research Design and Fr^lsed ure s : . i 

■ • . ■ ■ ■_ -.-^ . " . 

Uhderachievers among fifth and sixth graders were defined to be 

._ _ -"_■/ ___ _,?L_-_'J ' ^- 1^' ^' L . 

students with IQs of 110 or more, failing grades in mathematics i and 
failing grades 'in a t"^ least two more sulbj/ects (not includihg m^ 
drawing, aricJ gardening) . Second grader^ viewed as appropriate for 
tutoring were those with mathematics s^^ of b or e pn a scale of 
a, b, Q* All subjects were^b o ys ''to A 

associated with the phenomenon of uiiderachievement' at d^ • 
levels; arid to prevent the cdricept/^of' girlk teaching boys and vice 
versa from interfering with the results of the programU (p. 140). 



The fifth arid isixth graders: ti^^re selected as follows: 

a. Scores on a nationally adMnistered ach^ test had to be 

bfelow 65%. ^ ^ 

hi Then^ scores jDn a group-administered Israeli adaptation of the 
. ■ \ ■ Ldrge^Thblmiiike Intelligence Test had to be 90 "or above. 

c. Hien, scores on the WISC (individually administefed) had to be 
110 or above. - - . ' 
Thirty-siSc boys . sjatisfied these criteria.. 

The second graders wer^ selejcjted . as^^^^^^f^ . ^ 

a. Scores oJ a nationally administered achievement test had to be 
below 65%. 

■ rf- 

^_ .. • O _ _■ _ . _ _ _ ] ' _ _ . _ _ ' _' 

b. Scores pn MILCAN, "a new group intelligence test for the lower 
grades of primary school" (p. 140), had to be 90 or above. • (No 
reference f6r this test was |>r6vided.) \ 

c. The classroom teacher and the school psychologist had to agtee 
that the student Exhibited hd pathology. / 

Of the students meeting these criteria, the 36 with the highest iQs were 
selected as subjects. Y I 

(There is some lack of clarity about the nximber of pupils initially 
available for consideration. Theire is also ho rationale given for the 
particular cut-off used for the various tests.) > 

The 36 fifth and sixth graders completed a self-cdhcept questionnaire 
and then the teaching project was e^cplkined to them. Lots, were drawn to 
select the 18. tutors, with selections t)f experimental and control subjects 
tbatched on schools (there were three/ and classes within schools. Two 
tutors and two control group subjects .a^ed-to^^c^ that 
recjuest \^as granted-. — rThe""'18 second gradfers to be tutored were selected 
at random^ with matching again for schools and classes^ Parents of all 
subjects gave permission for the tutoring program. ^The -18 tutors and 18 \. 
tutees were ' randomly paired. 

The tutor/tutee pairs met three times per week for about four months. 
These sessions were in place op the regular mathematics classes. The 
ekperimenter visited each pair.weekly and met alone with the tiitdr one 
afternoon per week. The t^tor also met , weekly with the second :grader' s 
teacher to plan for the tutoring sessions. ^ The 'pay' for the tutor was 
extra help in learning English i which; was. viewed as one of the most ^ 



' difficult subjects. The 'total number of sessioas ranged from 26 to. 40^ 
\ and three of the tutors dropped out, reducing the nuiS^er of (experimentai 
stibjects^to 3b (15 tutors and^^^ ^ . 

* : ; The standardized mathematics test was administered as a pdsttest; 
. second graders took the same test that had been used in the selection 
process, and fifth and sixth graders took an alternative form of their 
pretest. The tutors were awarded certificates of completion in^ a public 
"asse^iy, and the following, day ^ the fifth and sixth graders completed the 
• self-^^con^ep questionnaire a second time. ' — - \^ 

. ^maiysiV of covariance was applied to each measure,^with the' . . ; 
corresponding pretest as the covariate. vGomparisbn of nuSer of failing . 
grades resulted in significantly different regression's lopes for the - 
experimental anci control groups,, so a t-test was used to analyze' these 
. data. \ \ ''■} 



4. binding s \: ' 

The tutees showed more improvement on the standardized mathematics 
test (p less than .05) than the hbn-tutored second graders. There was 
no difference in the groups on class grades. \ \ ' 

■•■ cThe tutors showed more improvement on- the standardizeci mathematics 
test (p less than .01) and more improvement in -class grades; :(p less than 
^.05) than the non-tutoring fifth and sixth graders.- The tutors also had 
a. significant decrease in number of failing --grades on report cards (p -less 
than .05) when conqjared to "the non- tutors.. There was no significant 
difference in self-concept. 



The findings support the assumption that peer ^ tutoring benef its-i:oth 
the tutor and th The overall iinprovemerit in school work by the ./ 

tutors is viewed as the most in5)ortant finding of the study. Such overall / 
improvement may increase the confidence of the tutors and improve the / 
perceptions; .of teachers and parents about the likelihood of future 
achievement of the^ tutbr§. This may improve! the motivation of the tutors / ' 
and may alter the cycle of underachievement. " : 

■The lack of improveipent of the tutees on class marks may be related 
to the relatively coarse scale used <at' that grade;; Too, : teachers may have 



beexi reluctazit to award liziprove4 tnarks to students who were absent from 
nathematlcs classes three days per week. Alternately teachers may hot 
have viewed any Improvement In tnathetnatics performance as permanent, and 
^tss may have acted conservatively in awarding marks. ' 

The lack of effect on self-concept may be due to the relatively short 
duratioi of the experiment. : * 

. — — ' iflastractor^s gommeiits 

. At a superficial level, the study seems to be fairly cleanly conducted, 
though exact replication of the research might be somewhat difficult. Of . 
particular concern in this regard is the seemingly arbitrary cut-offs 
used for identifying the underachievers to be tutars and the second graders 
to be tutees. 'The specific definition of uadej^chieving suggests that the 
definition of underachievement may have been created after the data'fbr 
potential subjects were examined. Too, the uniquenesses of the Israeli 
educational system would prevent replication outside Israel. 

At_,a more detailed level, the study lacks iii^iortant information; namely, 
. the reader does not know what behaviors took place during the tutoring. 
Apparently the experimenter did' not identify for the tutors what was 
e3q>ected of them. Further,;^ the report contains no information about what 
the tutors actually did to try to help the tutees. Much more Information 
about the range of behaviors occurring in the tutoring sessions would 
hAii^e^beeh extremely helpful.^ 

Of potentially deep concern about this study is that it doesn^t seem 
to represent a si^ciif leant extension of the theoretical nK^del underlying 
it. The bes^' cdriclusidn that can be made is that mathematics tutoring ' 
era assis'^t^underachievers in iinp academe performahce. There was 

apparently no attempt to determine what aspects of the tutoring experience 
aictually effected the observed changes. That seems to be the most important ' 
kind of information that is tieeded to expand and clarify the learning- 
through- teaching model. Additional short-term studies probably won't be 
very useful -in providing this kind of information. / 

__ _ I 

Too J follow-up is ned'ded to find out if the effects that were observed 
are sustained. This relates to finding out what characteristics of / 
tutoring cause the improvement among the tutors. If continual tutoring 



is required to maintain the gains that the tutors displayed, then tutoring 
Say not be a realistic instructional procedure for improving performanci^. 
( By knowing what aspects of tutoring cause the improvement^ teachers might 

be abie to incorporate those aspects into regular classroom instruction. 
; . : Finally , the results arising out of -the self-cphcept data are somewhat 

unexpected. The description of the recognition, given to the tutors in 
the pidblic assembly caused this reviewer to expect a'>strohg self-concept . 
inprovemeht among the tutors. Further investigation of . the reasons for 
the lack of this elfedt would seem to be called for., Certainly ^ the public 
assembly caused a confounding of the effect on self-concept. The effect 
of ^the -tutoring on self-concept camot separated from the combined 
* effect of tutoring with public recognition. 




erJc 



Becker A Wesley c\ arid. ,Gersten, Russell. A FOLLOW-UP OF FOLLOW^TO^UGH- 
IHE lAmR.EFFECTS OF TOE DIRECT ipTRU^rdi^f^^M^^^ 0^ CHILDREN IN FIFTH 
AND .SIXTH GRADES. Amerioan Educational R eseareti^ Jwrnal 19: 75-92 • 
Spring 1982. ~ ■ : — 

Abstract Sarid comnieriti . prepared for i .M.E. iy LARRY LEUTZINGER, Area Educatiori 
Agency^?, Cedar Falls, Iowa. , ■ 

1. ^ Purpose . , . f ' 

This ^tudy investigated the longrrange effects !of Direct Instruction 

• ' • _ ■ _. « _ ^ ■_ ' • ' • 

Follow Tnrougji.. The progratns , being evaluated began 'in first grade and 

continued through third grade. The students tested Wre fifth and sixth: 

graders who had been out of the Follow Through progr^ for two or three 

years* The students were evaluated in the areas bf^ reading ^ spelling, .^ord : • 

.knowledge , ianguage , inatlieinatics computation , mathematics concepts , ma the- 

matlcs ^problem solving, and science.: 

2. Rationale ^ . , 

When" Direct Instruction Follow .:Throu^ sites, Were evaluated after- 
tfiree years of instruction in the. mid-I970s\ the third-grade students I . 
performed significantly better in 8d^ of the tested items for mathematics^ 
5QZ iu spelling, 60% in ^reading, and 100% in language. Whereas these 
data Indicate t^at the Direct Instruction programs were- successful, it was 
'deeTOd important to evaluate the progress of the students involved in the 
program in later years to determine if their achievement levels reiiiairied 
high, as compared to similar:, groups of* students .who had not .been a/ p^trt ^ 
of Direct Instruction Follow Through. 



3. Research and Design Procedures j 

~K'~19757~62^ ~f if th- and sixth- involved 
in Direct Instruction Follow Through iii first through third grades were 
tested using the Metropolitan Achievement Test (MAT), Intermediate Level, 
and Levels I and* II of the reading subtest of the Wide Range Achievement 
test (WRAT). The students who participated were f rom^ five representative 
sites (East St. Louis, Illinois; Smithville, Tennessee J Uvalde, Texas;' 
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Dayton, Ohio; Tupelo^ Mississippi) which voiunte'ered to be a part of the . - 
study. • These students' test .results were compared to those of 567/ 
hbn-Fdllow Through students of similar backgrounds and abilities from? 
the same five sites ^ In addition, the Follow Through students' results , 
were compared to the national norm sample. The study was replicated in ^ 
1976 and involved A73 Follow* Through students. In this study only four . 
of the origiaal five sites were involved. . ^; ■ 

An Immense amount of data was-^gathered and scrutinized. The test 
Liresuits from ail students involved were evaluated using-^ quasi-experime^ 
design. For each Follow Through site^ analysis of cdvariahce /was performed \ 
on each subtest of the WRAT and MAT. The sites were then classified as 
significant, suggestive of a .frehd^ oj; qxjnsignific^ A meta-analysis ; 
technique where the P values on analysis of covariance for each site were 
-Ranged to chi-square ratios a^d tested for significance was then us^d. 

Finally, the average magnitude of effect in pooled standard deviation 
tmtts for each subtest at each grade level was calculated./ The method . 
gives ah estimate of the treatment effect that is not biased by the differ- 
ential, sa^le sizes at the various sites (page 81). ./ 



4. gjtndings 



1- 



V- The ANCOVA comparisons for each fifth- and sixth-^grade group on all 
the subtests of the WRAT and the MAT indicate that 56 of the site compariscjlns 
favor the Follow Through groups at the .15 level of significance and 
itiafJnparisbns are not statistically significint. Twenty additional comparis^'ons 
*^iSwf-the'Follow Through groups; at the . 15 l^vj^ of significance a^^ 
^i^dtisdris are not statistically si^ctif icant.\ Of tfie 180 possible 
comparisons, only two favor the non- Follow Through groups, at the .15:levfel 

- - - -- /V- ■ • ■ / - - ■■ ■ , • ^ 

of significance. ^ . , /. 

On the mathematics gf^rti on 'of— the. MAT, which?, includes concept V ^^mpii^^ 
and problem-solving: subtests the Follow Through groups were favored at /the; 
.15 level of significance or better in 5 o2 11 comparisons on the cdmpucation^-^: q 
subtest. Oh the concepts subtest, 5 of the 14 cbtaparisons favored the 
Fpllow Through groups ^t the .05 level of signiflfcance. On the problejr 



solving subtest, 7 of the/^ft comparisons favored the Follow Through groups 
at; the .15 level of significance or better. Of the 39 possible comparisons., 
on the mathematics subtests of the ifAt, in only one case were the non- 
Follow Through groups ^iavored at the . .15 level of significance. 
, j On the meta-analysis using cfii-square ratios for the pooled results , 
the Follow Through groups were favored in 8 of the. 12 subtest categories . . 
for both Grades 5 and 6. On the mathematics probiein-sol^ for 
fifth grade, the chi~square analysis indicates a significance at the .05 
level in favor of the Follow Through groups. At the sirth-grade level 
the results for each mathematics subtest favor the Follow Through groups . 
at the .05 level of significance. 

When the Follow Through groups are compared to the norm sample, the . ; 
percentile rankings on the WRAT arid MAT subtests Indicate a dramatic decrease 
from, third through sixth grades The average. of the percentile rankings for ; . 
the sites involved on th^ mathematics subtest of the MAT is 62% at the end 
of tii±rd\ grade; By the end of fifth grade the average percentile ranking 
has fallen to 31% and by the end of the sixth grade the average is 27%. 



5./ Interpretations 

./ Graduates of ; the Direct Instruction Follow Through Program perform 
better ' than similar children who were hot ^ part of the program as measured 
b^' btkhdardized achievement tests. The differences are most striking in 
fISAT reading and MAT mathematics problem solving and spelling. No outcomes 
ffi^ri5^_tHe* non- Follow Thro ugh^ groups at the .05 level of. significance, 
wfiiIS^3i% of the coiiq)arisbns favored the Fpllbw Through groups. 

While the Follow Through graduates dutperfbtnn other low- income ^ifth , 
and sixth graders in their communities, they fail to kee^ mi with middle- 
income students. The failure appears to occur in' cdmpUtatidiial J^kill . 
-development- in mathematics and vocabulary development ;<md_readi^^ comprehension. 

"In order for these children to become fully literate adults, it 4^ears 

they need high-quality instructional programs in the intermediate graded 

(and probably beyond)" (page 89). 



Abstractor* s Cbmmehts 



' Before begirihing n^r critique of tj^^ articie^ a- brief explanation of 
the follow Through program is in order. Follow Through was designed as 
■both a research and a dentils tration pro j as 
a fbilow-up to the ^Head Start Program. Developers of i innovative programs ^ ^ 
worked with local school districts or sites who volunteered'^ to implement 
a particular sponsor's model. These models ranged frbm'pighl^ 
ones:like /i)l instruction to open, loosely sWiittiir^^ ones. 

Follow .ITxrough was^ conceived in 1967 and is the-4argest educational 
experiment ever conducted, with over 500 miilidn'dbllars invested in 15 
years. The costs of evaluating the variipus programs alone were estimated^ : 
at 5D miilion dollars. \ 

The results of the eval^ation of the Foiiow Through , pro grams point to - 
the superiority' of the Direct Ins tructibh Model to others i&ed. However, ' 
questions were raised about the evaluation regarding the lack of comparable 

control groups and the reliability of tislng nori-Follow through data as the 

- __ - ■ •• , ■ _• _■ ■ ■ .. ■.. . '\' ' ■-■ 

basis of comparison. The same; questions can be ral^sed regarding this' study, 

but someone -with a stronger statistical background that :1 should ^b s^. V 

Not being a statistician by nature, one of two things usually happens^ ^ ^ ; 

f?hen I come across masses of data. I either am greatly impressed Sy the 

insight and perseverance it took to complete and evaluate the informatibn, 

■pr i nkively question wh^ts^it all means and if it was worth" the effort. 

For this study 1 was impressed by the amount of data. To. do ah analysis* 

of ' CO variance with as many variables as were involved is a monumental task,' 

even f of^ a computer. . Then to analyze the scores of each subtest fbr / - 

significance is impressive. ' . . 

; What bothers me about the statistics , arid this . may be naivety 

again, is the lack of consistency in the reporting of the results. Some of ^ -J 

this inconsis tency is- due- to -misprints- or deletions-. —These kinds^ of^-errors - i 

are understandable when this much information is reported. Heaven knoi^^s , * vrj 

there may be a mispelling or two in this very review; [ I'J 



On Table II it appears the .'tiiiiabers listed for the mathematics computation- 
subtest in the 1976 study^are misrepresented ^ since drily three sites are 
listed— - 'hot six. In Table li]r^he_degrees bf freedom' for the Grade 6 . 
language subtest shouiid be *i4; On Table Jtlt the^tit indicates that there ^ ; 
are seven Follow' Through sites . While the number of^sites^^ed in the cbmparisoix 
varied for different analyses, at times being ten, eight, five^ fbur,i_a^d 
threeV seven is hot a likely number and represents a misprint. The misprint^- 
asidit this inconsistency in the- number j of sites included in the various 
^aiyses raises questions regardkng the intent of the statistics. 

On Table' I the* sampie sizes for the fifth grades are , listed. But later 
ih the study these numbers change for the Tupelo and Smithville sites on 
Table VI and for the Tupelo, Smithville, and Dayton sites on Table Vil. 
No reason is listed for these discrepancies. ^ 
' While this study professes to assess the later effects of the Direct 

instruction Follow Through at five diverse sites, in none of the eight 
tables displaying inf ormation^is a cbmplete picture presented.. By 
county in 64 cases data are missing or unavaiiabiei Oh some of .the tables . 
nearly .2^% of the data is missing. Even the tables which have no missing 
data are dependent. on previous results where data were missing, it is 
difficult to draw valid conclusions from incomplete data, \' 

^JJhen presenting information, usually the least massaged dat^ appear 
first. In this study that "is hot the case. The unadjusted percentiles 
for the subtests on the MAT and WRAT appear near the end of the report. 
For those scores the fifth-gtade Follow Through groups are statistically * 
no differeht than the. noh-Follbw Through groups in the MAT reading, total 
mathematics,, spelling, and science subtests. From previous tables the 
conclusion was drawn that the Follow Sirough groups . were clearly isuperior • 
to the non-Follow Through groups. For the fifth-grade groups in 1975 

this was not true. . v 

Since percentile rankings are not the most sophisticated means of 
evaluating data, perhaps they should be replaced by more profound methods. 
Oh the other hand, it was the last sets of percentile scores that made 
tlie greatest impression oh me. ih those, th^ longitudinal analyses; of the 



percent lie s for^ the two tests were' displly^d. Despite the fact that data 
TOte tn^ssiiig, a * trend was appa^^^ 6n the subtests 

for the sixth-grade students were about bhe-^half of the scores for the 
last year of the Follow Through^i^ 

•precipitous and distressing. As cited in the article^ "There is Sow a need 
to; implement and evalniate instructional pro^grams in t intermediate grades 
that systematically utilize principles of 4±rect ins t^^t ion," which include 
mastery- liarriing , high level of feedback, and incremental steps to develop 
independent readings writing and critical thinking" (page 89) • If these 
^suggestl^s are implemented,^ :p can be stemmed, 

Despfte-dtsj^shortcomingSi this artacle addresses a real need in 
educational research^ that^of Ibrigitudihal evaluation of programs and 
projects. The effort was Eoade ^^^that^regard is commendable. Iii- the future 
researchers should attempt to build in aTda^Ta collection scheme wMch 
allows for the consistent, systematic evaluation of prdgramis over a period 
of time. After all, learning ~is;a"^change of behavior and the true^measure 
of whether a change hats occurred should be based on more than a one-time 
assessment. . 



/ 

/ 

/ 

/ ■ 



ERIC 



34 



Cathcart^ W. ^ George. EFFECTS OF A BILINGUAL INSTRUCTIONAL PROGRAtJ 
ffll CONGEPTUAL DEVELOPMENT IN PRIMARY SCHOOL CHILDREN. Alberta 
Journal of Education Research 8: 31-43; March 1982. / 

'. ~^ ~ ■ • ■ .- * ■ . ■ ' .;■'/■.' 

Afistract and comments prepired ^dr' I^M;E. b DOlfeLAS :H. CtEt^ 
Kent State University, Kent, Ohio. * / | . 

. ' ■ . 1 ' , ■ ; ■■ * ' 

1. ' Parpbse ^. ' ..v • , / 

— « — . - - _ ■ - ■ - 

The purpose of the study was to investigate whether a 

bilingual instructional program would positively affect children's 

concept formation and cognitive furictibhing as measured by j 

Piagetian conservation tasks and related verbal rationalizations:; 

1 - • -r ■ V . • ■ . ■ / . ■ ; • 

2. Rationale : 

Evidence is reviewed that children who are fully bilingual 
'seem to have some cognitive advantagies over uniiihgual .children, 
including increased "cognitive plasticity," achlev^iiient , and , 
divergent thinking ability. Do bilingual ins tftictiorial programs 
provide these advantages^f or students? Evaluations of bilingual 
prograztis in Canada provide some evidence that children erirblled 
-jin* them perform higher on assessments of cognitive development, » 
Intelligence, and divergent thinking; however, it appears that 
a threshold of linguistic competence must be attained for these 
effects to manifest thems elves. ^^^Eyidehce cbncirning effects bf 
bilingaai instruction on concept der^iopment as defined by ; , 
Piagetian cbhservation tasks is sparse* but seems--tb indicate; 
that children in the programs perfbrra as well or better than-.^ 
their monolingual controls. 

3. Research Design and Procedures 

Subjects were 192 children: four boys and four girls 
randomly selected from each program (French/English biiinguai. or 
English) at each of grades 1, 2, and 3 in each bf four schbols. To 
measure concept forma tidn, they were administered a iS-item test 



^ . JL... 

assessing number and measurement conservation* Four number subtests 

- ^ -■ ^ ■- ■ ••- - ■ ^' _ L'^'- - - ■ 

Involved numbers less than 10 j numbers greater than 10 J/ additive 



rearrangement, and quantity. Four meafsurement subtests included 
lengthy area I inass> arid vd 

subtests was counterbalanced^ In addition, as a measure of 
cdgriitlve functioning," children * s iratiqn^ conservation 
vere categorized as (a) operational :identity, Cby subs tMtive 
Identity, (c) reversibility ^ (d) compensation i or (^e^ other. If 
a rationalization was given, a second was requested/ The researcher 
and two graduate assistants tested all .children Inuiyidually . , 
Adequate reliability of_the cdriservation t^ast wasjassumed based 
on previous research. Inter-rater reliability £^r the classification 

jof tlie ratibrializatioris was determined to be '^^^ 

For the^econd- and' thir^-grade students^ ^percentile scores - 

'on. the Metropolitan Readiriess Test administered during the first 



grade were used as a covariate in a three--way^analysis of. 
cdvarlance (grade x program x sex). No covai/iate was available ' 
for the first-grade students. 




4. Findings ^ // 

• - ■ • , - - ; • -- II' ' - - ■ -- ■ 

The adjusted means of the bilirigual ^rpup were higher on five 



of the subtests, the reverse was true for'^ne subtest, 'and the 
groups had identical means on one subtest. Results of the analysis 

:■■ - - ? * ■ ■/ - * : :- \ - - - 

of variance adjusted for readiness scores revealed that these , \ 
differences were significant for onljr/ tiwo subtests, additive- 
rear r^ngemerit and length, in favor d_^f the bilingual group. 

The number of second rationaliz:at:ions' given was taken to be 
a Indicator of cognitive flexibility. The difference in the 
unadjusted means was statistically significant in favor of the 
blllrigiial children; however , the adjusted means were riot 
significantly different. Since -there was a significant grade--by-- , 
program iriteraction, separate arialyses were performed for :the 
grade 2 and grade 3 samples. There was no difference at the . 



'grade 2 level, Imt the adjusted mean of the bilingual grade 3 classes 
was significantl:^^reatfer than the adjusted mean of the English 
classes* The. adjusted peari of the children in the bilingual 
classes on the ratlonai^ization of reversibility was also ^ 
sighif icantly greater than the corresponding mean of ; the children 
in the English classes. No other means differed sighif icantly 

" r!ffiere" were also some grade -differences/^^ ffi grade 
3 cdiildreh was significantly greater than that of the gtade 2 : 
^iidren on three number conservation subtests and on the number 
of second. rationalizations given. There were no significant 
differences on any other items. 

oSince hone of these results jincluded grade 1 childreh* _t tests , 
done between the bilingual and the English classed were reported. 
There were no sighificant differences at grade 1 on the conservation 
.subtests* There was a significant difference in favor of the 
bilingual group on the number of second rationalizations given 
at grades l^and"3, but not at grade 2. 

5. ' jat e tpr e ta tiona 

The author pointed but that at best the "study provides ■ 

. . . ■ '■ 

only weak support for the hypothesis that the concepts* of number 
and measurement are more advanced in children who have been ih a 
bilingual class for less than "Ithree years" (py $2). , However, 
the magnitude of the a<lvantage for the. bilingual group did 
increase as time in the program increased offering sup^ for 
th3 "threshold" theory, which maintains that a certairi-ievei of • 
fluency need^ must tie attaihed before differences can be observed. 

The authorv suggested that the results were more con%rincing ^ 
with regard to cognitive functioning, as the niimber of second 
ratidhalizatidh^ and the use; of reviersibility were both at a 
higher lev6i in iphildren f rbin 'the bilingual classes, fie argued 
that this was hot due to greater verbal ability, for controlling 
for readiness score should Kave controlled this variable to some extent. 



it was concluded that the^' differences in favor of the 
bilingual classes provide justification for their continuation* 

/ While the findings* are not strongly in favor of bilingual 

instructional programs, they are suggestive, and certainly ^ 
indicate that these programs dOL tio t have any harmful effects on 
cognitive development as measu^red by coriservation tasks. 
Collaborative research ^ using these and other tasks is needed 
* before ^irm conclusions can be drawn. 

The^'number of subjects^ method of selection, and procedures 

CP ' . ■, 

used generally lend validity and reliability to the findings. 
However, several questions can still -be„raised. The author : 
states that children "who experienced difficulty often transferred 
out of the bilingual progriam or never registered in it. There- 
fdre» the 'better* pupils were in the bilingual program" (p. 36). 
to what degree could the finding that the children in the bilingual 
program increased their- advantage from first to third grade be 
attributable to the^ attrition of those children who were not, 
for whatever reason^ benefitting from the bilingual program? The"^ 
author argues t;hat the* use of a readiness test, as a covariate 
controlled for initial differences., But is it certaih^that .. 
controlling for variance in readiness, controlled for any variance 
±n develop ment? Alsd^ what of other differences that might have • 
; existed between the programs? It is not clear if the curricula 
/were equivalent, and, possibly moire important ^ JLf the teachers who 
/ choose to teach in the special bilingual program were themselves 
/ special in any way. However ^ to the extent that it can be assumed 

1 that the only difference between the experimental arid control 

1 • _ _^ • ^ _ ^_ _ _ ■ ■ ■ " ' ^ ■ . ■•. - ' ' 

conditions was that the former involved bilingual instruction,** 

the findings have signifi^iarit educational impiicatipnsi To this 

extent the study &lso highlights the importance of the role of ' 
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language in t^e development ofdlogtcal-matheinaticai concepts. 
This r die is frequent iy denied or minimized by some P4.agetiah~ . 
oriented researchers. - V. 

" It is. assumed that children's ratibrializatibhs are a^^^ m^^ 
of their ievei of cognitive functioning; ehiidren.in the 



----- • ■ » ■ ■ ■ ■ ■ • _ . . .- • ■ , . ■ - ^ , 

bilingual program gave more: reversibility-type arguments, the 

use of which was shown in previous research to be. related to 

higher performance. It is interesting to speculate; does 

translation between languages promote the development of a . j 

reversibility mind-set? Other, possibly non-verbal, Sssessments 

of reversibility and cognitive functioning may jJrovi'iie interesting 

insights into these problems. 

The study provides a useful review of the research, and offers \ 
* ' * . >. 

evidence that bilingual programs are not harmful, and may be 

beneficial, to children's cognitive developmeht. It also raises' 

interesting questions for future educational and developmental ^ 

research. :^ " ■ i 
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Gopky Cathy: J. and Dpssey, John A. BASIC FACT. THINKING ;:STia^ 
KHLtliPLlCATiON — REVISITED. Journal for-liesea:c^h-in Hathamatlcs-Educa^^ 
13: 163^171; May 1982. - ^ ^ 

Abstract and Vomments 'prepared for i.M.E. by JOSEPH N. PAYNE, University 
of Michigan 




.Purpose ^ 

The purpose t^as to compare results on muitipiication fact instruction 
rade 3 using tw& different approaches , to the facts. One approach 



used thinking patterns based dn special groups of reT.ated facts* Th 
second approach was Based on the size of the factors.; 



2. ^l:ionaIe ^ ^ 

Studies as early as 1935 were referenced to . indicatjB interest iijji 
basic fact instruction. The study, done by Thornton in 1978 was used 



a.8 a model f or ^the research. by Cook and Doss ey. Thornton's s;tudy dealt 
with addition/ sub tiraction, multiplication, and division facts in grades 
2 'and 4. Cook and bos'sey -modified Thornton's study by claiming to remove 
the experimenter bias by having regular classroom .teachers do the teaching, 
in addition, in-service was given to both treatment groups to equate 
drlll-^ahd-practice timfe to remove a problem they state may have existed 
in the Thornton study. Further, they lengthened the retention time and 
used grade 3 to assess early* learning of the facts,. suggesting that" 
Thornton's work in grade 4 may have been on releaming facts. ' 



3. Research Sesign and Procedures . . 

VThe sample cons is ted of 220 . (erroneously repor ted as 219 on page 
164) grade 3 studentsvfrbm SchatmSurg,' illinois.' Schools and third- 
grade classes were chosen at random, but there was no indication whether 
treatments were assigned to schools randomly. ' Two of the original classes 
were dropped because one school did hot fblldw the research design. The 
elimination of one school resulted in relatively unequal treatment groups, 
n « 134 for Thinking jStrategies and n ^ 86 for Factor Si^e. 
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. The Cognitive Abiiities Test was used as an aptitude testi /with no 
^'significant differences reported "for the two treatment groups (t » 0.07| 
. df ' 2i8)* Actual mean scores on ttxe test were not included in the 
. ' report. - ■ .j' 

The first in-s-eryice day (length of session not specified) dealt 
%rlth the teaching schedule for the nine-week experimental' period. On 
the second day (length again not specif ied), teachers in both groups 
constructed games and activities. , / 

Instruction lasted for nine schpdl wekks, for 20 minutes a day, 
beginning in mid-January. A one-minute timed quiz was given each week 
on the .facts studied so far, but no indication was given on how it was 
scored and apparently no analysis was made of the results. 
- Depehclent measures were the number bf'^the 55 multiplication facts 



students got correct in two minutes. Students were told to do the easiest 
ones first.- The facts *^tests- were given as a pretest* at the end of the 
3rd, 6th, and 9t:h week of instruction , and eight weeks later as a rietentidn 
testi with facts in a different' random order for each test. During the 
eight ^e^ks before the retention test^ the. classes studied the concept 
of division, division facts ^ and other, topics. ^.=^-—''^''^'"^-''' 

Means and standard deviations on each .test are reported by treatments 



and for the entire sample. A one-way ANQVA^was done for- growth scores 
from pretest, and also for growth scores between successive tests. A 
two-way ANOVA was done using method x aptitude, with aptitude defined 
as "high^V f or score above 120 on the^ Cogtiitive "Abilities Te^t arid "low" 



if below 160^ Dif f erentiai_^ffeci:s"''of the two treatments were examined 

for 14 "hard-facts'^*'''^^ 7x4, 7x6, 7x7, • 7x8, 7x9, 8x6, 8x7, ; / 

9x4, 9x6, 9x7, and 9x8) i 
- ■ * ' . . .■ . ; ' • -. ' ' : . 

4. ' :Findings — ' ^ , 

For the Thinking Strategies and Factor Size treatments, the mean 

scores were; respectively: pretest, 12.29, 12.69; test i, 28;39., 28.24: test 2. 
i 39.00,>35.00; pbsttest; 46.60, 43.55; and retention test, 48. 32^ 45.27. 

For grcjwth scores from the pretest, p < .05 for test 2, posttest, and 
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retention test in favor of the thinking Strategies. For growth betweeri 
'successive tests, test ;2 - test 1 fa^ thinking strategiesj but no 
other '"^difference was significant i (The article erroneously reports 
jidsttest - test; 2 as significant ;_the table shows 

scores computed from another table show a growth of 7.60 for Thinking 
Strategies and 8.48 for Fact Size between tesft 2 and possttest.) No aptitude 
X "method interaction, was significant,- tut the main -factor of thinking \. 
strategies showed p ^0.048 for test 2 - test 1. High and low aptitude 
groups gained 8.' 92 and 9.75 respectively, in< Thinking Stratergiesi but \. 
ohly'5.33 and 7.25, respectively ^ in Factor Size. A methods x aptitude 
analysis of the results on the 14 hard facts showed aptitude as al signif icanf: 
factor; 'high aptitude mean was about 11 and low aptitude mean was about 

6.- : " ' ■■■■ • .' ■ ' ^ . " . ■ . 



5. ■ In t er p r et a t ions 

The data support the thinking strategies approach for teaching 
multiplication facts* although both groups achieved a high level mastery 
in the end. The investigators suggest that the rapid growth during the ' 
fourth through sixth weeks for the Thinking Strategies group . allows 
for a shorten time to be spent on the facts and more time on the reviewing 
and relating these^ thinking strategies to the retention of the basic 
facts'^* (page 170). They note that teachers can be trained, to teach thinking 
strategies in a short period (two days). 

— ' ^ Abstractor s Comments 

The results from this study provide a helpful supplement to other 
fact studies and to the Thornton study especially. The information about 
the rapid growth of the Thinking Strategies group during the second three- 
week period-df instruction is new, suggesting that students need, three 
weeks for warm-up before the approach using thinking- strategies begins to 

take hold. Evidently, the major heuristics that must develop for thinking 

; ^_ •_ _ ^- : _. , : _■ _' \. Ll^.l^' _ _ _ A _ - -.■ 

strategies must be practiced a lot before their effectiveness can be 

. '_ ■ \ ' ■ 

recognized in the results. r \ . 



it is some tiling of a puzzle why the. thinking istrateglei were riot 
nore effective for the harder facts, when Thornton fotmd such startling 
differences. Could it be that this study /did hpt utilize her strategies 
for the ^harder facts? Why was aptitude the. more important factor here 
and not with the other facts? ' v 

There is no. indication of - the way the multiplication facts and • 
thinking strategies were used in the, subsequent work on division, taugfit 
in the postcest-to-retention-test p.er4od. Further, with suHh excellent 
results orr ^multiplication, it would be valuable to have results on 
diviaion. Tfc.^ results for multiplication and divisibn must be related. 

This, study contained no interview da ta_ that proved so interesting 
in Thornton's study. What strategies did students use who were in the . , 
Factor Size group? Further, what did: teachers do to help children •find 
answers? Surely, they would have skip cbuhted^ 'added^ or done something. ; 
Interviews and reports on what teachers actually did would have given' 
more itifbrmatibn oh what happened in ich treatmentf. 

Conqiarisons with Thornton's study would h^ve been-^easier if comparable 
tests and* times had been use^d. Thornton used 100 fact tests, with ttif ee- 
ininute Intervals, and identified 49 facts as ^ihard^" while Cook aiid 
'Dossey used~55 "facts , with two- intervals, and identified 14 "hard" 

facts. ' • . 

Both treatments had a more carefully laid-but plan for fact learning 
than is usually found. Nine weeks , of 'ins^tructldn were provided. Timed 
tests were given often. Games and practice were included. S*rpm all v 
this classroom work, it should be clear to teachers arid students tliat 
fact learning is important and ttiat time, must be provided both-' fot^ 
and practice. A 4>ianned^ pro^r'am ^ing thinking s tra tegies over ah ' extended 
period of time may be the message 't^^^^ 
draw from this study. ^" ' , ; 
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!• -Purpose ^ 

The study is intended to link/ two areas of current interest in 
mathematics education: the "mat^jfematical characteristics of prospective 
teachers^ and the notion of ieyels«of understanding" (p. 89) 




2. Rationale 

Those who have sough^t to explain the gap .^between the intentions oj 
curriculum reformers and what has been^chieved in the classroom have | 
viewed the mathematical characteristics of ' teachers as a' possible sduzjce 
of eacplanation. Mathematics educators have marvelled at. the fact that 
many students who have undertaken extensive studies in. mathematics , either 
at high school or in undergraduate courses| still seem to approach 
-mathematics as though it were a matter of applying set rules to produce 
routine answers t^standard textbook questions. .Many of these complaints 
are anecdotal, /^d have-not been supported by reliable evidence establishing 
the nature and extent of students* misunderstandings and misconceptions. 

• Respected writers .such as Howson (1975) , Gray (1975), and Buckiand 
(llSleS). have argued that mathematics graduates^ especially those who are 
preparing to become teachers, often lack a l^ively understanding of and 
sound competence in matSematical inquiry. These writers echo a widespr^d 
fear that^deficits in the present crop of prospective teachers will be 

~transmi"t:ted--^6--the'*^ext--genera-tion-^ 

/In this study* the researcher proposes to investigate the mathematical 
vitality of mathematics students "who are^among those currently enro^^led 

/in thd first year of an undergraduate; program, aiia^^hdse who are undertaking 
a course of teacher preparation after completion of an undergraduate qegree. 
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3* ' R e s earch - Besl grf a nd P r^^cedures 

The author asks what kinds of at tributeis would one e3q>ect to find ; 
in a "mathematically aware student". These attributes, which the author 
chooses to refer to under an tmbrella term "mathematicai yitaiity!*,- ar^ 
^those which^ he expects to be derived from a range of mairistream courses \ 
in mathematics and not from any particular course, ..His chosen criterion 
attributes include: - ' , 

(1) AppreciaticJn of logical . form including the ability to 

(a) write (and interpret :^inf erential statements^ 



'Y' (b) , distinguish between necessary and sufficient conditions 
! \_ and betwe^, implication and equivalence, ^ - 

• (c) imderstand the relation between statement and cbnversii 

\ (d) use counter examp lies effectively ^ ' " • ^ • 

V (e) evaluate! the validity of extended chains of reasoning such 
^ as proofs . i : . 

(2) A knowledge of the major conventions such as [xj and i*^" and 

- the Capacity to interpret them in context and with consistency. 



(3) The ability to intej^i^et the precise meaning of statements* 

e.g. definitions J ai^dy^judge whether specific criteria are adequate 
or have been met. 



(4) An .'understanding of f^undamental. notions of analysis such as the 

dlstlhctibh between the limit and value of a/ function, and 

. _ : . _ - . _ . . . . ' ' ■ . 

between continuous and dif f eren'ti^bl^ j 

(5) The capacity not- only to apply^ruies; e.g. tor derivatives, 

- - - , - - . . : ■ ' ■ "^"^S-l' ' i ■ ■ . , . 

but habitually to consider when ±t As legitimate to do so.,- 



Jfi) — Awarenesa^Q£^,po.sslb.llltles±and.J(japj^^ e.g. th at area 

should have the dimension of (length) ..i. 

(7) Awareness of the arbitrary meaning of a diefinitibh in xhathematicsV. 
and the capacity to explore properties of a mathematical system 
using a defined operation such 4s a * b 2(a + b) . 

(8) Awareness of the nature of the .cjomain of a function and its 
importance, in a variety of contexts. (pp. 91-92) 



miese attributes haviB"'been incorporated into aii 18-item test atiiizing 



multiple-choice responses. 



In birder to check wKether the test items were reliable* the author 
tried them out over a four-year period in one university on students who 
were. completing a course of teacher t after an initial degree which 

included a major or a minor study in mathematics. ; The author reports that 
th^ distribution of respp.nse patterns was relatively stable over the 
peribd of trials. 

The- study was then carried out on two groups of students in universities 



T.n tfitie Australian states. One group replicated the characteristics of 
the original trial group. The other group comprised students who had 
Just completed high school and who are studyiiig a "typical" first-year' 

course in mathematics. 

- Since no significant difference emerged among-states for each group, 
the author collapsed the.,six sample _groups into an xindergfaduate and post- 
graduate sample. Within each, group a t-test was carried but in order to 
determine whether the amount of prior study in mathematics was a significant 
factor affecting performance on the test. Croiss tabuiatdUdrls 

. carried out oh groups of items which were expected tp measujce the same 
attribute to ascertain whether success on any items was relatied to success 
on other items. ^ 

4« Findings . ■ \ ' 

The t- tests did not show any .significant difference in either group 
According to the amount of prior study at high school or at university. 
''iAJ.though the proportion of correct responses is usually higher at the post- 
graduate level, the author argues that 



— ^^ln~general--^t^here i s n o t ende nc y fo r th e^T'^^P^^^g^^ o 

^. graduate group to close in on_ the correct alternative in comparison 
with the corresponding undergraduate, patterns, (p. 102) 

Cross tabulations did not reveal any discernible hierarchy among 
items which embodied similar mathematical task's. , ' 



^ ; On tlie 18 items of the test i the postgraduate^ g^^ a 
pSrdpbrtioii of correct response'^" in excess of 40% on seven items only. ; 
The postgraduate group scored between 21% ajid 40% correct on, nine itemisv - 
whereas the undergraduate group had ii items with the same band of correct * 
responses, and a lower response race on four items. 

5. ■ Tnterpretations • : . ■ ] . ■ 

, From the low proportion of correct responses, the, author infers that * 
sdine mathematical concepts are genuinely difficult to acquire. From the 
distriBuwiori of correct responses the researdher 'propose^ to ; i^ 
ilnk gaps in students' mathematical performance-, and se^s to explain 
these deficiencies in terms of underlying problems rather than looking only 
at the .propbrtiori of right and , wrong responses in eacfi group. . 

The author argues that the level of mathematical -vitality achieved 
by tindirgridiiate students . is "independent of iocai/cbntexts with regard • 
to precise syllabus content and curriculijm emphasis" (pi 107). For . 
postgraduate students, mathematical vitality is /itxde^^^ 

tertiar^ institution and of specific units studied. Horeover,. he argues 
that the miscbhceptibris revealed by the test /tend to, remain and' are 
unafHfeGted-despiteJurther; courses in mathematics. He contends that 
mathematical vitality is not improved by stuciying more mathematics at 
university. 

"In order to e3q)lain the poor performance of both groups^ on many items, 
the author invokes a distinction betw^een "relational" and "instrumental''^ 
understanding (cf.Skemp^ i976). Ah instriimental tmder standing of mathematics 
consists of mastering a collection) of rules and procedures which are to 
be applied in isolation from 'other elements of matHematical understanding. ^ 
Oh the other hand, a striving for consistency, coherence, and a sense of y 
interriiationships among fundamental mathematical ideas characterize ... 
"relational mathematics". . ^ 

- The author posits a relationship between these of understanding 

and the contexts ih which/mathem^ Even where/ 

one would assume that courses at tertlaiy level have been taught with 
"relational intent"^ instrumental learning can still resulB: 



/ 
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It seem3 that relational intent bh the 
Instructor can be defeatied when "success'' c^h be 
achieved by retreating to and perf dm 

level» e.g. by learning and reproducin^^^^ . ^^-^ 

techniques, for examination purpbseis (p. . 108) . . : 

: :: . ^ school rand university matheaaatics achieved 

by opting for a siiipler instrtMenta those wHb 'become 

teachers are likely to perpetuate instrim^ntai patterns of learning in their'"^ 
own clai^srdoms. Previous research oh links betwe^eri teacher knowledge ; 
and student performance has * tended to concentrate on teachers * knowledge ; 

of sf)ecific. mathematical cbhteht. However^ mathematibal vitality as^^^^^l^. . - 

_ _.j \ \ \ /_ ■ ._. _ -. ■ _ _■ _ _ _ ^ I _ ■ '" . ■ „ _ ■ ■ . ■'■ 

a measure of ! ''relational mathematics" is quite different from "mere content 

knovledge". It is recoimnended that further research on this characteristic , 

of * teachers/ and the, mathematical performance of their students be under takeul' 

Abs^raGtor-s^Coments^ - 

In tl^is section, I ask about the author's interpretation of test 
reBults, yoff er some explanatdrjr remarks about the Australian context ;Ln 
which the study was conducted, and discuss /the attribute of:"mathematical 
vitality" which the test is presiimed to ineksiire. Theh^ I Attend to the. 
distinctibS which the authbr roafces betweeik "reiatibnai" and ''instrtimen 
axid relate this distinction do some limitatibns/of the conceptual framework \ 
of the study itself. ; ^; / * 

. , The author does leave liriexplaihed the wide range of correct responses, 
•a feature common to both groups. For the undergraduate sample, the proportion 
of correct responses is as high as 94%. and as low as 5%. Is it pbssibie 
that some items are more closely reflated to the specific content of, : - 

mathematics courses thkn others?. Readers would be interested tb knby 
what explanation the author might offer for this feature. Nor does the . * 
author explain why the perfbrmance of the pbstgraduate sample is markedly ; :■ ■ 

better on many items than that of the undergraduate''grbu|>. ,It may be . . ■ 
triae that some elements of the fbrmer grbup cannot be distinguished f 
other elements according to the number of units of .mathematics studied at 
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tertiary level, | However its performance caii be distiiiguished a^ generaliy 
more soccessrt^l; on loany/ Items than that' of ;the undergraduate group. The 
performance of /the trndergfadiiate group outstrips that of the postgfadiiate ■ 
group oh three itenis only. Given the author ' s .cdritentidn that "mathematical 
vitality- is not enhanced by the mere process of studying more mathematics : 
at the tertiary level" (p, id?) ^ any discrepancy in perforina^ 
the, two groups should^ be addressed. , 

The author's reasons for treating his . two sample groups from a 
national perspective are wiell supported by 'ah\ analysis of results from 
state to state. Many Australian readers of the study would support these 
reasons .from their own knowledge and. experience of Australian courses 
in mathematics. However, an overseas reader may need to be aware that 
mathematiics. courses in the final year of high school iri Australia are 
usually academically oriented, with most courses containing solid dompon-. . 
ents/ of calculus and statistics. Those who in the undergraduate sample, 
were enrolled in "typical first-year mathematics courses at university ' 
hady on the basis "of their high school results, successfully gained entri^ 
to university as distinct from a coiiege of advanced education. It is also 
likely that those typical first-^year courses had as prerequisites certain 



mathematics courses at year 12, which in their turn required a high level 
of performance in mathematics courses iri the preceding years. Thus, the . r 
f±rst-year\indergraduate sample would contain a specially selected group 
of students. V' . ^ ^■ 

The authdr^s cdnclusidns do cast a gloomy shadow over the cladtms of ] 
those. who promised a revival of mathematical understanding following the 
Intrbductioh df riewX^urses in? mathe^ during the 19603 and 197bs. 

An initial response tovihe items of Galbraith's test might be to ask 
whether they do indeed li^asure mathematical vitality. Clearly the items 
require students to exhibit a degree of mathematical insight and logical 
discrimihatidn, but amdrig the characteristics df mathematical vitality 
i would expect to see an understanding of the interaction between mathematics 
and reality; for example, the ability to use a mathematical mod^l "td , ; 
help raise. or answer questions about^ physical reality, as well as techniques / 



EKLC 



for exploring the- behavior of the models Nthemselves" (Buck and Buck^ 
1965); Given GalbraithVs eiaphasis on reiat:±onal understandings one would 
expect that an ability to explore the: relationships between 
and physical reality vduid .be prominent ^mong^^he attributes' td_^ be investi-- 
gated by his study. 

At issiie is the way in wfiich the terms "relafcidrial'V and "ins tri^ 
are employed by Galbraith in interpreting his resurts. His use of these 
adjectives in three quite different contexts heeds far more unpacking if 
they are: to carry the weight of interpretation which hte hopes for. 1 ' . \ r 
doubt whether Skemp's original distinction between rdlaMb instrumental 
understanding can be maintained clearly and consistently even with relatively _ 
simple cognitive .performances. I find this distinction between relational . 

-and Instrumental understanding still mdre impiausible^when- it-is-extend 

to the kinds of complex mathematical performances which -are embodied in . 
Galbraith's test item^^ Even those students who know how to differentiate 
know. In a possibly radimeStary way, when it is appropriate to do so,: 
and they are ;llso likely to haVe a sense of what constitutes an appropriate 
restilt* when that- operation is applied, in this respect they. seem, to display 
a' measure of relational understand if sd dne canndt simply classify 

their performance as solely ins trtmien tali Further diff icult"i'es"~ari^e ] [ ~ 
wten Galbraith attacfhes these adjectives to mathematics,.. His references 
to' •'•relational mathematics" and "instrumental mathematics" give an , 
Impression that he is referring to some consistently identifiable attribute ^ 
of ma tlifematlcial performance i However, his intended meaning is far from ; • 

clfeiii'; :* Similarly i his references to "relational teachihg"^arid "instrumental 
tta&fehltig" are further extensions from SkempVs original dist^^^ c 
Unfortunately, Galbraith^^'draws his readers into these uncertain pedagogical 
distlnctidns with very few guid^posts.: Is it intended that * the links 
between relational/ instrumental teachings rerational/ihstrumental mathematics, 
and relatiorial/instriMerit^l understand causal? If ^ they^ aire, then 

the causal "links need more interpretation and elucidation. They need -to ^.i^^^^^^^ ■ 
be discussed and illustrated rather than left to the reader s imagination 
as one slips from teaching to mathematics, and from mathematics to under standing.^ 



■ . _ ^_ : ^ _ ■•Vrj- 

£ Sttspect that Galbraith iritends to use these terms, in order to orient the . .. 
reader to . examine the- beliefs^ purpb&es^ and values which uiider pin different 
contexts of teaching and* learning mathefflatics. . He does alrlude to the kinds 

' of beliefs^ purposeis^: and values which mig!i[t; haVe influenced the poor „ 
performance of students the test. But these cdhjectures. aire post hoc 

. rationalizationis of his test results, and they draw attention to the 
underlying inability of his conceptual fraineWork^to illuminate our under- 
standiSg of teaching and learning mathematics. ; ^ * 

. Galbraith's study; has sought to use psychological explM of 
teaching and learning mathematics i His use of a, distinction between 
reiatidhal arid iristrimerital uriderstM of ; that ■ .' ^ . 

distinction to mathematics and teaching is typical of a psychological 



'reductionism which has dpmiriated many, studies of' teaching and learning. 

The conceptual framework oF\his study with its inherent psychological 
reductibhism conceals and- precludes a fuller and inbre complete description 
of the social context of teaching. Iliat context should include reference , 
to ^he beliefs^ purpbses, and values^ and to; patterns of wprlc and know- . 
' ledge -Which govern what j happens in ciassrboms. Galbraith suggests a link 
* between certain patterns of~^-eaching and certain kinds of learning „ * 



/ 



outcomes. But his ; conceptual framework is. bound to ignore impdrtarit 



questions of -how and why certain approaches to : teaching and learning 

preddmiriate iri the matliematics classrodm. Galbraith quite rightly refuses 

. _ J _ __ __ _■ _ __^4_" _•_ ■ .j_ " ■ ' _ L ■ . _ _ _ L. ■ <■ ■ ' 

to explain such outcomes in terms of teachers V knowledge, but his 

_- \: _ _ 0 - _ _ - ]■ -- _ -■■.-\ 1 . - 

alternative explariatidris are outlined in a few taritalizirigly brief sentences, 
in order to investigate these^ alternatives , Galbraith would need to' throw 
^ff the blinkers of a categbrizatibn.of teaching and lea has 
become totally dependent upon psychological ciassificatory systems. • His 
own concept ual framewo'rk does allow iiim tb explbre tRe possibility that 

students, whether in sjchooi or universityi, learn not only the subject matter' 

-of mathematics, but through their work they are taught the appropriate forms. ; 
in which to cast their! knowledge. -This ^ work as a sociaf and ethical :■. 

"|Cbristruct is hecessaryj in order to p^ortray effectively the social dimension of" 
the acquisition arid application of mathematical knowledge. 
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•A psychological reductionist model of teaching Sand learning distorts 
the nature of math em^ treating it as ah isolated intellectual 

enterprise. Mathematics is a human activity whose development cannot be 
imdetstood without reference to an historically situated community of 
scholars* The development and vitality of mathematical not. 
well portrayed by trie qpystaiiized forms which are present in Galbraith*s 

; test.' \ • N - ' • ■ 

r ... Mathematics, as Bu^k (1965) argues, is . 

■v-iT ' marked by ^ inventions j discoveries , guesses - both good and- 
bad, ^d . ..«tlie frontier of its growth is covered^ by 
interesting unanswered" questions, (p. 951^ 

palbraith's ridtipn of mathematical vitality bears^oniy -a slight resefibience 

to this picture of mathematics as an intellectual craft ca:jrried but in a 

cbmmuhity''bf other vital mirids. His notion of mathematical vitality is 

confined and attenuated underi the influence of his own conceptfual' framework. 

That framework prevents us from ekp'ibring important social dimensions of 

inathematical knowledge, and, in particpar, the beliefs , purposes , and values 

which influence how mathematics, is .taught and learned. . / 

•. ■ ■ ■ ■ ■ /. . ) ' ■ " ' ■ . • 
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IKhoiiry; Helen Adi ahd;.Behr3_Mer^^^ 
DIFFERENCES, AND MODEis QF REPRESENTATION. ^ Journaj for Researcfr^ 
Mathematics Education 13; 3-15^ January 1982, / 

Abstract and comments prepared for I.M.E. by J. PAUL McLAUGHLTll^ 
Purdue University Calumet, Hammond, Indiana. 

1. Burpose 

Potential sources of variability ori tasks which require an 
interplay between representational modes are of interest. This study . 
investigated the relationship of two variables -^-^ field dependence/ 
independence and spatial visualization ability — to performance of 
college students on retention tests involving problems .pr-e^ehted in 
(a) pictorial mode only, (b) symbolic mode only, and (c) mixid 
•aySolic/pictbrial modes. "The study also, investigated « the extent to 
whtch tiie four variables — field dependence/independence,' spatial 
visoalization ability, symbbiic mode retention test performance^ and 
pictorial ;iibde retention test performance — ^ account for the. variability 
in the ret^tion test ^perforaance on tasks requiring ah interplay 
between the symbbiic atid the pictorial modes" (p. 3), i.e», performance 
on the mixed syiiibiic/pico trial iaodes retention tests. 

2. JlatioQ^le 

"Field independence refers to a predispbsitibri to perceive the 
^virbnment in analytic terms, or differentiated fashion, and field i 
dependence refers to a predisposition to perceive the environment in » 
a glbbai arid undifferentiated fashion" (p. 4). Subjects which tend 
toward field ihdependehce should perform tasks involving a mixture of 
represeritatiorial mbdes more -easily than those who tefid toward field 
dependence. A field dependent sullject would be more likely tb 
translate all tasks to the mode with which he, or she feels more 
comfortable.. A subjedt who tends to field independence would, be more 
likely to work with the representational mode used in the task presenta- 
tion. * . .. • 



; i^t iris, hypothesized . that field depe;ndent sxibjects with high *, : * 
spatial -vis uali 2a tip ability would perform as well or better than: 
field/independent subjects with low spatial visuaii2fatiott ability and 
field independent students with high spatial visualization ability 
.irould score/ better, dri mixed mode .tasks than field dependent students . ; 
with low spatiar visualization abilityi 

3i Research Design and Procedures . ! ' 

Subjects were 96 students iri two intact classes of a university 
course in methods of teaching elementary school mathematics • Th 
were .82 females and r4 males. , Alio were preservice ''elementary school 
teachers. " - ' 

Two pericil-and-paper tests : — Gottschaldt Hidden Figures Test 
(HFT) to determine field dependence/independence and - the Purdue r . 
Spatial Visualization Test (SPV) to assess spatial visualization 
ability ~ were tak;en\by all subjects* 

This testing was^^^^J^ by one week of instruction on whole 

number a<lditibn* algorithms using counting s ticks and btmdles ' of 
count ittg sticks for the manipulative mode^," pictures representing the* 
sticks and bundles of sticks for the pictorial mode, and the horizontal 
equation algorithm for the symbolic nrodei The steps in symbplic 
algorithms are illustrated by the following example. • _.. 

. 12 + 13 « n 
aO + 2) + (10^+ n 
(10 + 10) V (2 + '3) = n / 

(10 + 10) + 5 « n ; 

\ . V\' ^ ■'.20 + 5 ■» n / ... ■ 

f . ■ ' ; • ••: r ' . 25 --n ' " ' .; : / ' 

r A post-treatment test was administered, immediat following the 
treatment i arid a retehtidh tes t was giv^n three ti^eeks after the treatment'. 
Scores on the retention test 'were ased in the analysis . * (Scores on 



tha ppst-treatineht test showed- very stnall variance.) The retention test 
consisted of six pictorial mode problem^ » six 'syii£oiic mode prbbieiDS ,' and 
six. Mxed- mode prbbleiQs : In each castg btud^rits were to select from 
asspng five possibilities the correct "statementV or '^picture" at each 
fijtage of a six- or eight-step addition problem. On the mixed mode 
problems, the representational taode was alternated from step to step in 
the soiuCibn .' 

4. Findings > . 

With each of the three parts on the retention test considered 
''separately, the results of the three retention tests, the HFT, and the 
SPV were: 

Maximum 

Mean Possible Std. deviation 
Pictorial Mode: 3.58 '6.80 1.80 

Syiiibblic Mode: 5.04 6.00 1.55 \ 

Mixed Mode: 4.59" . 6.00 1.63 . . 

HFT Score: 8.41 20.00 5.01 

* . . • . . * 

* SPV'Score: 54.89 . 80.00 .9.89 

Cotrrelations between the various modes of representation (pictorial, 
symbolic,* and mixed) ranged from 0.64 to 0.83. Correlations between 
the SPV (spatial visualization) atid the three modes of representation^ 
ranged from 0.18 to 0i21w Cbrrelations between the HFT (field dependent/ 
independent) arid the. three modes of representation ranged from 0.27 
to 0.33; The -correlation between the SPV scores and tfier-HFT measures 
was 0.48. , . 

^ Stepwise regression analysis using the HFT and SPV scores as 
independent variables indicated that scores on the HFT accounted for 
less than ii% of the yariafice in each of the retention^tes ts and the 
SPV accounted for less that 1% of '■the variance. 

Stepwise regression analysis : using the miked mode retention test / 
score as the dependent variable and the ottiirvfbur test scores as 
in4ependerit. variables indicated that.-^£he Symbolic Mode Retention test 



score accounted for 68.6Z of the variance in the scores on the Mixed 
Mode Retention test; the Pictorial Mode score , 0. 8Z; the SPV score, : 
0.2Z; and HFT score, 0.02%. : 

Using 2x2x3 factorial analysis of variance (High-^Low SPV by 
High-Low HFT by Pictorial-Symbolic-Mixed Mode) ^ a significant within- 
subject main effect diie to the retention test mode was observed, but 
no other within-subject effect was significant. Analysis of variance 
also indicated a significant between-subject main effect due to spatial 
visualization ability. No significant main effect due to- HFT (field 
dependence/independence) was indicated. . 

5, " interpretations^ 

While scores on the HFT correlated somewhat higher than the spatial 
visuaiizatiori scores with each of the thre„e,„xetention-tes:t- mpd^ — 
HFT score accounted for l^^^^hanr 11% of the variability in the 
performance test scores. Scores on the symbolic mode retention test 
accounted for 68.6% of the variance in the 

with the other three ^ests combined accounting for IZ. Of the ^ . 
retention, tests the synfiolic mode was easiest for students ^ the ^ 
pictorial mode the most difficult. A significant interaction effect: 
between spatial visualization and the retention test mode was found. 
Tfie. greatest difference in group, mems was on- the pictorial test between 
t^^:]til^ spatial visualization group andy Sie^ iow^ spatial visualization 

gpoup.: •■ . ■^■ .'■ . , ::.v, ^< -^re5; aric ~ 

Further research on the effects of fie'ld dependence/independence 
and spatial visualizaiton on mixed representational mode performance is 
suggested. 

Studies should use students during their early encounters with the 
'subject matter. Subjects in-.this study were familiar with the content 
except possibly for the : manipulative arid pictorial represehtatiohal - 
mo.de.. Studies in which the subject matter is new or unfamiliar to the 
students^ involved should produce greater variance. 



Aba tractb r * s Comments _ ■ 

I felt' the. rationale was Incomplete • Some discussion of how a 
• tendency- toward field dependence might affect a student's per fptinance 
oh the tasks used in this study would have 'been helpful. Also, Is 
spatial visualization aBirlity independent of field dependence/ 
independence? Why would only -three of 61 students fall in the "field 
dependent-high spatial visualizatidn" group in the High-Low crosging^ of 
iffiese two groups? There was no hypothesis 'on how high spatial ^\ 
visualization ability- field independent, subjects wdiild compare to high - 
/spatial visualization ability- field dependent subjects i Nor was 
there a hypothesis ovl how low spatial visualizatioti ability-field 
independent subjects would compare to low spatial visualization 

ability- field dependent subjects. \^ ^ 

__t_-. . ; 'i^ __• : ' .__ ' 

The use of ' subject matter which students are already expected to 

have mastered^ with the only n^w element being the mode of representation^ 

: would appear to limit the tisefulness of the results. Perhaps this, 

could have been alleviated somewhat by using some number base other 

than ten in the teaching and testing. \: ^ 

it would seem; appropriate to have one test Involving the manipula- 

tlves as the repre^ehtatidhal.jnpde. Iri fact, the use of pencil-and- 



pa^er, muiitpie- choice tests does not appear to be appropriate when 
Y one is examining the relation betwe^ri^fi^ld dependence/independence / 
and representational mode^ An interview fdrmat or written comcient 
format in which students indicate their thinkrng wduld yield useful 
infotmation. . Such results would be much more difficult to analyze and 



Interpret; however^ the desirability o^ having such iiifdrmatidii is 
implied in the conclusion of the report^ where some student comments are 
included. * ' " 

Just how good is the match between manipaiatives that are used; 
the pictures which we draw to represent steps in an algorithmic. , 
process, and the steps we write in the symbolic "^algorithm? 



Hov much work with tnanipolatives and pictorial representations is 
necessary of apprbpriatie? For whom is\ it appropriate? What information 
'about a child's cognitive style would guide the. teacher in making 
decisions (answering these questions) for one child or a group of 

"children? The answers to these questions would. be useful to teachers and 

\ __ __ __. ^__'r ._. ; '.■ 

to: those in mathematics education who prepare and/or work with teachers 

and future teachers.- Research of the. type of -this repoxt would help 

provide some of these answers. ' 
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Schoenf eld^ iAl^^ OF PROBLQf-SOLVJNG PERFOR^ 

PRDBIiiM-SOLVING INSTRUCTION^ Journal for Research In Mathematics < 
Educati on 13: 31-^49; January* 1982, 



Abstract arid comments prepared for I.M.E. by ARTHUR F. COXFORD, 
The University of Michigan 1 

1, Purpose 

Two purposes were central: (1) "to ddcument the results of a 
nbnth-iong intensive probleny-solving cbtxrse on students' perforiiance 
wheii sdlvlrig norirdutlne college level mathematics problems"; (2) to 
present and discuss the easily graded paper-and-pencii tests that focus 
oil prdbleitt-solving processes used to measure the problem solving of 
the si£jects. 

i 

■ ,' ~ __ ' _ ^ ___ _~ _ 

Professional and research groups suggest that prbblem-sblving in 

inathematlcs is a major goal of mathematics instruction. Yet problem- 
solving is notoriously difficult to teach. That heuristics provide a 
basis for improved prdblemrsolving performance has been supported in a 
^variety of recent investigations. Additional support would be useful 
in thh development of research directidris. T^ie usual procedure in 

; ■ _■ ■ ' _._ __ _ _ ^^-r^r 

such work is protocol analysis i This method is time-inef f ic'ieht and 
costly. The development of cbst-eff icierit alternatives is desirable. 

The research itself is;based upon three working assumptions. 
These are that necessary cdriditions for success in problem solving are: 

1) an adequate mathematical knowledge base of facts and principles; 

2) a mastery of basic problem-solving techniques -—heuristics 
similar to thosp described by Polya; and 

3) a managerial strategy which is used to select appropriate 
teqhriiques and terminate inappropriate ones. 

The author points out that the complexity and subtlety of the use . of 
heuristics should not be unde-.as timated (p. 32). 





. The basic design was pretes t-^posttest With a "control" groups" 
The experimental group (consisted of. 11 students at a sinall liberal arts _ 
college who enrolled in an intensive month-long problem-solving course 
(2-% hours of class work f or 18 consecutive weekd^ys^ plus\ homework) . 
This was the only course elected, and ail the time was spent examining 
relevant heuristics and solving problems in as many ways as possible. 

The "control" group was a group of eight similar students enrolled 
lii a mbhth-lbng course in structured programming "designed to teach a 
structured, orderiy*:way to approach problems." As the author recognized, ' 
the "cbhtrol" group wa^^of lJ.mited use because it did not deal with 
mathematical problem solving, n ' \ 

Thtee pretest-posttest assessments were taken. Measure 1, five 
items with 20 minutes allowed for each, assessed the subjects' problem- 
solving skill and the successful and unsuccessful strategies tried. 
This meaisure was scored in tw^b ^ays: multiple count and best approach 
scoring, in the former ^ credit was given for ail work, whereas in. the 
latter bhly the best effort was evaluated. Measure 2^ six items with . 
4 minutes^ response time given after each item on iteasare i, assessed the 

subjects' self perceptions of their prbblem sblving. Measure 3 assessed 

"_ _ _ __. _ _'_ '_■ 1' I ■ ■_ 

taearistic fluency and transfer. It included nine items: three each 

of problems' reflated, somewhat ^elated^ and not related to the instructional 

problems. The students were given one^our to present a ylajx for a 

solutxoh 'to^^ieach item. (Finished sdiutibris" wer^ no t» requested.) The. 

^tSiree pretests were given oh day 1 of insltruction; the posttests were 

given on the last day of class. . . - - 

4w • Findings 

Measure 1: Using the "multiple cbuiit" scbririg, the "control" group 
esdiibited only minor changes in pretest to posttest performances The 
eacperimental groiip^* which was similar to the control grbup on the 
pretest, showed substantial improvement, i^ posttest scores. For example, 
they solved bnly .27 problems per student initially, while solving 2.64 
in the posttest. ' 



■/ Using the "best approach" scoring with a range of 0-100^ the 

■_r-_ _ _._ _ '_ '* '_ . L_ ^ _ L 1 

/"cohtrbl" group increased from 14% to 24%, while the experimental group 
increasrd from 20.8% to 72.2%. ; .. J ...^ ..^.^ '^. ;'J^... .^ 

Measure 2: The two groups were roughly cpmpariable on the pretest. 
On the pbsttest^ the "control" group showed moderate change in their- 
self-perception, while the experimental group showed increased planning 
and thinking about the solution before actually beginning the process; 
Measure 3: The "control" group showed essentially no change from 

'the pre- to the posttest measures. On the pretest, the treatment 
group was unexplainably superior to the " con trdl" group . The treatineht 
group also showed evidence of fluency of heuristic use in tfr^ "somewhat 

-related" problems and actually completely solved some "closely related" 
problems in the six or seven^mihutes available for each problem, even 
though asked only to plan the solution- 
s' Interpretations 

The author concluded/ that the measures used were reliable and 
Informative. The scoring was consistent across trained scorers. 
Additionally, the self^^Lrceptions of the experimental -group ^ith regard 
to planning and to brgahizatioh were accurate. Similarly , the "control" 
group showed no such improvement in planhing and organising solutions. 

The author suggested : that without some heuristics to manage, a manager 

_ - - - . • - . - _ - - ■ ' -/ - _ 1 " " ~ ^ _ _ - _ - - 

will not be able to do much. No specific cbnclusions could be toade from 

the data regarding managerial strategies, but the author opined that 

..."more riches lie in a better uriderstahdirig of how good problem solvers 

.-- 1 __^_/ L , __ „ 

perceive * the problems they work on and select various approaches to them 

(p. 48). . / . .. ^ 



Abstractor ' s Comments 



It would be easy for a reviewer to be^ critical of the design of 
this investigation, for the. subjects were not randomly assigned to 
treatment, the N's were prohibitively small,* and the subjects were, drawn 
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from a select population* However^ . for this study on this topic 'at 
this time in the development of research iia mathematical^ e^^ stich 
criticism would be petty . Problem solving ;is^ the objecti 
iiis true tidn and little reliable info rmat ion is available for the 
practitioners The work reported here eSibits promise of both theoretical 
and practical relevance. . ^ 

Heuristics have been touted as appropriate tools for the problem 
solvlhg for ye^rs. « Yet little has been said about how one learns to 
employ the myraid of heuristics. -The concept of a "managerial system" 
seisms : a viable one which should be investigated further. The practitioner 
and the : theoretician need information on the manner in. which the 
heuristics were taught j which pnes were taught, how students i/ere 
taught ^o "manage" them, what 'clues were used iri heuristic solution, 
etCi As the author concludes i this is/ a cbmplex topic — one that 
cdUld ^ertainly prof it from a cbllabbra^ion of mathematics ^educatdrs ' 
and cognitive psychologists interes^^a in high ievelphuman functioning^ 
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Hiebe» James Hi USING eRADED QUIZZES, HeM^ ATTENDANCE TOR 

iDtiVAflNG STUDY IN A COtLEGE MATH,CLASS, . Mathemattcs and Compu tex 
Education 16; 24-28; Winter 1982 ^ \ 

■ * _■ _ \ / _ 

Abstract and coasments prepared 'for I.M.E. by JOE D^ AUSTIN^ Rice\ 
Ifaiversity. 

; 1» iut pose. ' \ , " 

The purpose of this study was to deter^ne^the effect. on college 
mathematics students "of attempts by instructors \o make sure that^ . 
students properly manage their study "^time through the use of graded 
qulasases^ hon^wprk and attendance" (p. 25). 

2. Rationale 

At the college level teachers often assume that students are self- ^ I 
motivated and responsible for deciding the frequency of their home ; ( / 
study and class attendance. Itl such sitiiationgv.ingtructbrs of^^^ 
nohgraded quizzes and nongraded homework to provide feedback to students. 
Other instructors attempt to require students to study regularly by 
using graded homework and- graded quizzes. * : 

Studies on the effects of homework^ quizzes^ and tests have been 
mixed. There is evidence that at the high school level homework, ' 
frequent tests, and quizzes can in5)rbve^ achievement in mathematics. 
However, these studies have not seemed to generalize as well to the college 
level'. Also, ^e studies have considered separately the effects of 
homework, tests, and quizzes. No studies were found that attempted to 
study the effects of. homework, graded quizzes, and required attendance 
as a unified procedure. This study attempted' to study the effect of 
the unified procedure of g-raded homework, graded quizzes, and required 
attendance on college students' attitudes and achievement scores. •* 

3. Research Design and Procedures „_ - 

Ail students in sxx classes of Mathematics 180 (Theory of Arithmetic) 
were involved in this study. .About two-thirds of the students were 



elementary or special education inajbrs. About btie-^slxth were In otHer 
areas of education. The remainder were in business or liberal arts.\ 
Ihe study lasted two njoriths. 

niree Instructors taught two sections each of Matheinatics ISO* 

• . ' ^T-- \: 

For each instructor one claiss was ^randomly selected to serve as an \ 

_ : - - _ - -.- ... - - . . • - '■ - - f^- ^ : . - , . \. 

eacperimental class, while the Other class of each ins true tot seirved 

as a control class. In the three ^experimental classes homework was 

assigned^ collected, and graded; ^maimbuiiced quizrzes were given at 

least once a week; and attendance was checked. ^ The final grade was 

based oh attendance and scores oh exaini nations -j quizzes^ and homework. 

The three control classes had homework assigned and discussed in ..class , 

but 'not collected. The qui2szes giv&h to the experimental classes were 

hai&ded out as study guides in the control, classes and discussed. The 

final grade was based only on examination gradias. 

All students took a multiple choice (arithmetic skills) pretest and 
. an (achievement) posttest. Each completed at the end of- the study 
a questionnaire ori attitude toward mathematics, toward Theory of 
Arithmetic, and toward classroom grading procedures. 

The two groups • exper:imental classes and control classes — were 
compared using posttest scores, attitude toward mathematics,- attitude 

toward classroom fading proceudres^ a^d drop-out rates. 

— ■ ft ' 

4. ; Fiddings ' " . , 

Using the posttest achievement' data, "a statistical analysis showed 
no si^lficant differences" (p. 26) between groups. "No significant 
differences were found between the two groups in attitude toward / . 
mathematics or the methods used in the course which did not relate to 
the irideperiderit variables"" (p. 26). Significant differences V^re found 
between the two groups on attitudes toward grading techniques used in 
the study. Each group favored the grading technique that had actually ■ 
been used with it over the other grading technique. "Differences . in . 
dropout rates did not appear to be significant" * (p. 26). 
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5i Interpretations • ! . . / j 

The' results of this study suggest that for' cbllejge taatlxematics students 
the effort required to collect and grade hbme^^ and correct , 

quizzes > akd to check attendance does not result in. increased achievement 
or better student attitudes toward mathematics. However, the study 
does not imply that instructors simply lecture and give exsminations , 
as both groups h regular feedback. The cbritrbl group' hac: review 
sheets and homewbrk problems that were discussed but not collected. 
The« results of the analysis, of student attitudes on grading procedures 
suggest that students ciii become accustomed to either grading policy 
used in the study. j . - 

^ttJdies with students lih bther majors and in other college mathemat^c^^^ 
cburses are needed to determine ; whether- the ire^^^^ study 
.;geueraiize to other populations and to other mathematics courses. 

! Abstractor's .Comments^^ 

This is an interesting:study that addresses a question j that seems 
i^ortant. The cbii±>ined effects of homework, quizzes, andjrequifed 
attendance is a reasonable treatment to study. The study is well 
designed. It is a plus that| each instructor taiight a class in each 
tireatinent group and that classes were randomly assigned to treatment 
groups. The article was particularly readable. Finally , the author 
Is careful that . the interpretations are consistent wi.th, repbrted results. 

In spite of the inany positive aspects of the study, a^u^er:of 
Important questions exist. Tliese questions include the following: 

1. Hbw many students were in the six Mathematics 180 classes? 

2. What were the reliabilities of the two "tests and qijestionnaires? 

3. \Why were nb mean s^reis for either group given? j 

4. What statistical maiyses were used tb decide whether there^ 



were* significant differences? What alpha level was used? 

\. ' j _ - _ ^ . 

5.0 Why was no statistical test made on the drop-out rates? What 

were the drop-out rates for the two groups? 



6. Were the pretest scores used ±n any analysis? Were attitudes 

Coward flhebry of Arithmetic analyzed? 
7; What was the attendance rate for the experiinentai classes? 

This reviewer feels that this is an incredible list of basic questions 
that cazindt be answered. For sotzie questions it is hard not to fault 
alspythe editor • For exampie^ in question one Sie course nunier is 
given but hot the number of students in the study! These questions j . 
seem solsasic and extensive that one has no idea how valid £he results • 
are likely to. be. Most of the questions could probably be ahwered.^ In 
fact, the author indicates that a- more, detailed report is available from 
him. However, even a shortened report should briefly address some if 

not all of these questions. ' " . 7*^ 

in su^nai^^ it is hot possible to decide whether the results are 
valid or not. Too much important information is simpiy missing. 
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